US 2023/0410444 A1Published application

Display system for displaying mixed reality space image andprocessing method for use of display system

AssigneeCanon Kabushiki Kaisha

InventorSHUNSUKE IKENISHI

Life of this patent

Estimating the term…

Loading patent…

Abstract

A display system includes a processor and a memory coupled to the processor and storing instructions that, when executed by the processor, cause the processor to function as: a position-orientation acquisition unit that acquires a position and orientation of the image pickup apparatus based on a first frame of the real space image, a generation unit that generates a first frame of the virtual space image on the basis of the position and orientation of the image pickup apparatus based on the first frame of the real space image, a first image combining unit that combines a frame different from the first frame of the real space image with the first frame of the virtual space image, and a second image combining unit that combines the first frame of the real space image with the first frame of the virtual space image.

Claims18

Dependent claims

A display system comprising:

at least one processor and at least one memory coupled to the at least one processor and storing instructions that, when executed by the at least one processor, cause the at least one processor to function as:
a position-orientation acquisition unit configured to acquire a position and orientation of an image pickup apparatus based on a captured real space image;
a generation unit configured to generate a virtual space image based on the position and orientation;
a first image combining unit configured to generate a first mixed reality space image obtained by combining the captured real space image with the generated virtual space image;
and
a second image combining unit configured generate a second mixed reality space image obtained by combining the captured real space image with the generated virtual space image,
wherein the position-orientation acquisition unit acquires the position and orientation of the image pickup apparatus based on a first frame of the captured real space image,
wherein the generation unit generates a first frame of the generated virtual space image based on the position and orientation of the image pickup apparatus in the first frame of the captured real space image,
wherein the first image combining unit combines a frame different from the first frame of the captured real space image with the first frame of the generated virtual space image, and
wherein the second image combining unit combines the first frame of the captured real space image with the first frame of the generated virtual space image.

7 more elements

Dependencies are inferred from the claim text.

Facts

Application: 18/334,064Filed 13 Jun 2023
Priority: JP 2022-09733016 Jun 2022
Published: 21 Dec 2023
Term ends: Not estimatedThe source records don’t support an estimate.

Classification10 codes

G06T 7/73
Determining position or orientation of objects or cameras: using feature-based methods
G06T 19/006
Manipulating three-dimensional [3D] models or images for computer graphics: mixed reality
G06T 7/70
Image analysis: determining position or orientation of objects or cameras
G02B 2027/0138
Characterised by optical features: comprising image capture systems, e.g. camera

Family

US 12,374,061 B2Related patent
US 2023/0410444 A1This patent

From the US filing history. Foreign family members aren’t listed.

Timeline

Citations

Open elsewhere

Building an agent or pulling many patents? Use the API or MCP server instead of scraping pages. Get an API key