Method of image processing for three-dimensional reconstruction in an extended reality environment and a head mounted display
AssigneeVarjo Technologies Oy
InventorsMikko Strandborg, Kai Inha, Mikko Ollila
Life of this patent
Estimating the term…
Abstract
Disclosed is method of image processing for three-dimensional reconstruction in an extended reality environment. The method includes defining a set of visual-attributes derived from reference images; identifying presence of at least one visual-attribute in a displayable content of target images to be used for the three-dimensional reconstruction; and modifying the displayable content of the target images, by concealing or displaying the identified at least one visual-attribute, for the three-dimensional reconstruction in the extended reality environment.
Claims13
A method of image processing for three-dimensional reconstruction in an extended reality environment, the method comprising:
- defining a set of visual-attributes derived from reference images, wherein the set of visual-attributes comprises at least one of:
- one or more areas in a displayable content of the reference images,
- one or more objects in the displayable content of the reference images,
- one or more colours in the displayable content of the reference images,
- one or more textures in the displayable content of the reference images;
- identifying a presence of at least one visual-attribute in a displayable content of target images to be used for the three-dimensional reconstruction;
- and
- modifying the displayable content of the target images, by concealing or displaying the identified at least one visual-attribute, for the three-dimensional reconstruction in the extended reality environment, wherein modifying the displayable content further comprises:
- concealing the identified at least one visual-attribute, when the identified at least one visual-attribute relates to conceal-attributes and a number of the conceal-attributes are less than display-attributes in the displayable content of the images, and
- displaying the identified at least one visual-attribute, when the identified at least one visual-attribute relates to the display-attributes and a number of the display-attributes are less than the conceal-attributes in the displayable content of the images.
A head mounted display comprising:
- a camera for capturing target images,
- a processor operatively coupled to the camera, the processor being configured to:
- define a set of visual-attributes derived from reference images, wherein the set of visual-attributes comprises at least one of:
- one or more areas in a displayable content of the reference images,
- one or more objects in the displayable content of the reference images,
- one or more colours in the displayable content of the reference images,
- one or more textures in the displayable content of the reference images;
- identify a presence of at least one visual-attribute in a displayable content of the target images to be used for a three-dimensional reconstruction;
- and
- modify the displayable content of the target images, by concealing or displaying the identified at least one visual-attribute, for the three-dimensional reconstruction in an extended reality environment;
- a memory, operatively coupled to the processor, for storing the displayable content;
- and
- a display screen, operatively coupled to the processor, for viewing the displayable content, wherein modifying the displayable content comprises:
- concealing the identified at least one visual-attribute, when the identified at least one visual-attribute relates to conceal-attributes and a number of the conceal-attributes are less than display-attributes in the displayable content of the target images, and
- displaying the identified at least one visual-attribute, when the identified at least one visual-attribute relates to the display-attributes and a number of the display-attributes are less than the conceal-attributes in the displayable content of the target images.
Dependencies are inferred from the claim text.