Back to results
US 2021/0239978 A1Published application
Image generation apparatus and image generation method
AssigneesSony Interactive Entertainment Inc., Sony Interactive Entertainment Europe Limited
InventorsTomohiro Oto, Simon Mark Benson, Ian Henry Bickerstaff
Life of this patent
Estimating the term…
Abstract
Methods and apparatus provide for an acquisition process to acquire information relating to at least one of a position and a rotation of a camera operated by a user and an image generation process to generate an image to be displayed on a display unit viewed by the user in a first frequency lower than a second frequency corresponding to a frame rate of the display unit using information relating to at least one of a position and a rotation acquired at a certain point of time by the acquisition process.
Claims18
1:
- An image generation apparatus, comprising:
- a processor coupled to a memory storing instructions that when executed by the processor, configure the processor to implement:
- an acquisition process to acquire information relating to at least one of a position and a rotation of a camera operated by a user;
- an image generation process to generate an image to be displayed on a display unit viewed by the user in a first frequency lower than a second frequency corresponding to a frame rate of the display unit using information relating to at least one of a position and a rotation acquired at a certain point of time by the acquisition process.
1 more element
2:
- A display unit, comprising:
- a processor coupled to a memory storing instructions that when executed by the processor, configure the processor to implement:
- a correction processing process to receive an image to be displayed on the display unit viewed by a user generated in a first frequency by an image generation apparatus using information relating to at least one of a position and a rotation of a camera operated by the user acquired at a certain point of time and correct the image generated by the image generation apparatus using updated information relating to at least one of the position and the rotation at a different point of time, wherein:
- the correction processing process receives updated information relating to at least one of a position and a rotation in a second frequency corresponding to a frame rate of the display unit and performs multiple times of correction of the image generated by the image generation apparatus in the first frequency using a plurality of the updated information relating to at least one of the position and the rotation received in the second frequency higher than the first frequency.
1 more element
3:
- The display unit according to claim 2, wherein the correction processing process receives n (where n is an integer equal to or greater than 2) pieces of the updated information relating to at least one of the position and the rotation in the second frequency higher than the first frequency and performs n times of correction of the same image generated by the image generation apparatus in the first frequency using the n pieces of the updated information relating to at least one of the position and the rotation.
4:
- The display unit according to claim 2, wherein the correction processing process receives n (where n is an integer equal to or greater than 2) pieces of the updated information relating to at least one of the position and the rotation in the second frequency higher than the first frequency and performs the first correction of the image generated by the image generation apparatus in the first frequency using the first piece of the updated information relating to at least one of the position and the rotation and then performs the i-th (where i=2, . . . , n) correction of the image corrected by the (i−1)-th correction using the i-th piece of the updated information relating to at least one of the position and the rotation.
5:
- The display unit according to claim 2, wherein the correction processing process, when the correction of the image causes a missing portion, fills up the missing portion with a color of pixels on an outermost periphery of the image.
6:
- The display unit according to claim 2, wherein the correction processing process, when the correction of the image causes a missing portion, fills up the missing portion with a predetermined single color.
7:
- The display unit according to claim 2, wherein the image generation apparatus renders a region greater than the outermost periphery of the image in advance so that the correction of the image causes no missing portion.
8:
- The display unit according to claim 2, wherein the correction processing process performs the correction of the image controlling a movement amount between different time points so that the correction of the image causes no missing portion.
9:
- The display unit according to claim 8, wherein the correction processing process limits the movement amount to a predetermined limit value and when the movement amount exceeds the predetermined limit value, performs the correction of the image assuming that the movement amount is the predetermined limit value.
10:
- The display unit according to claim 8, wherein the correction processing process, when the movement amount exceeds a predetermined limit value, does not perform the correction of the image but performs an error process.
11:
- The display unit according to claim 8, wherein the correction processing process sets a first limit value and a second limit value greater than the first limit value and when the movement amount exceeds the first limit value but is equal to or smaller than the second limit value, performs the correction of the image assuming that the movement amount is the first limit value, and when the movement amount exceeds the second limit value, does not perform the correction of the image but performs an error process.
12:
- An image correction method, comprising:
- a correction processing step for receiving an image to be displayed on a display unit viewed by a user generated in a first frequency by an image generation apparatus using information relating to at least one of a position and a rotation of a camera operated by the user acquired at a certain point of time and correcting the image generated by the image generation apparatus using updated information relating to at least one of the position and the rotation at a different point of time, wherein:
- the correction processing step receives updated information relating to at least one of a position and a rotation in a second frequency corresponding to a frame rate of the display unit and performs multiple times of correction of the image generated by the image generation apparatus in the first frequency using a plurality of the updated information relating to at least one of the position and the rotation received in the second frequency higher than the first frequency.
13:
- A non-transitory computer-readable medium that stores therein a program causing a computer to execute an image generation method, the method comprising:
- a correction processing step for receiving an image to be displayed on a display unit viewed by a user generated in a first frequency by an image generation apparatus using information relating to at least one of a position and a rotation of a camera operated by the user acquired at a certain point of time and correcting the image generated by the image generation apparatus using updated information relating to at least one of the position and the rotation at a different point of time, wherein:
- the correction processing step receives updated information relating to at least one of a position and a rotation in a second frequency corresponding to a frame rate of the display unit and performs multiple times of correction of the image generated by the image generation apparatus in the first frequency using a plurality of the updated information relating to at least one of the position and the rotation received in the second frequency higher than the first frequency.
14:
- A system comprising an image generation apparatus and a display unit viewed by a user, wherein the image generation apparatus comprises:
- a processor coupled to a memory storing instructions that when executed by the processor, configure the processor to implement:
- an acquisition process to acquire information relating to at least one of a position and a rotation of a camera operated by the user;
- an image generation process to generate an image to be displayed on the display unit in a first frequency lower than a second frequency corresponding to a frame rate of the display unit using information relating to at least one of a position and a rotation acquired at a certain point of time by the acquisition process, and
- wherein the display unit comprises:
- a processor coupled to a memory storing instructions that when executed by the processor, configure the processor to implement:
- a correction processing process to receive an image to be displayed on the display unit generated in a first frequency by an image generation apparatus using information relating to at least one of a position and a rotation of a camera operated by the user acquired at a certain point of time and correct the image generated by the image generation apparatus using updated information relating to at least one of the position and the rotation at a different point of time, wherein:
- the correction processing process receives updated information relating to at least one of a position and a rotation in a second frequency corresponding to a frame rate of the display unit and performs multiple times of correction of the image generated by the image generation apparatus in the first frequency using a plurality of the updated information relating to at least one of the position and the rotation received in the second frequency higher than the first frequency.
5 more elements
15:
- The image generation apparatus according to claim 1, wherein the image generation apparatus is a server.
16:
- The image generation apparatus according to claim 15, wherein the server receives information of the camera operation from a terminal coupled to the display unit and sends the generated image to the terminal via a network.
17:
- The image generation apparatus according to claim 1, wherein the camera operation is performed for a real or virtual space.
18:
- An image generation apparatus, comprising:
- a processor coupled to a memory storing instructions that when executed by the processor, configure the processor to implement:
- an acquisition process to acquire information relating to at least one of a position and a rotation of a camera operated by a user;
- an image generation process to generate an image to be displayed on a display unit viewed by the user using information relating to at least one of a position and a rotation acquired at a certain point of time by the acquisition process;
- and
- a correction processing process to receive updated information relating to at least one of a position and a rotation at a different point of time from the acquisition process and correct the image generated by the image generation process using the updated information relating to at least one of the position and the rotation, wherein:
- the image generation process generates the image to be displayed on the display unit using the information relating to at least one of the position and the rotation in a first frequency;
- and
- the correction processing process receives updated information relating to at least one of a position and a rotation from the acquisition process in a second frequency corresponding to a frame rate of the display unit and performs multiple times of correction of the image generated by the image generation process in the first frequency using a plurality of the updated information relating to at least one of the position and the rotation received in the second frequency higher than the first frequency.
6 more elements