Discrimination between virtual objects and real objects in a mixed reality scene
AssigneeSony Interactive Entertainment Inc.
InventorsYiwei Yang, Warren Benedetto
Life of this patent
Estimating the term…
Abstract
A method for providing a mixed reality (MR) experience is provided, including: rendering a mixed reality view for a user on an MR headset, wherein the mixed reality view includes virtual elements; during the rendering of the mixed reality view, capturing sensor data by the MR headset, and analyzing the sensor data to detect real-world objects in a local environment in which the MR headset is disposed; determining a risk to the user posed by one or more of the identified real-world objects; responsive to determining the risk, then adjusting an appearance of at least one virtual element.
Claims20
A method for providing a mixed reality (MR) experience, comprising:
- rendering a mixed reality view for a user on an MR headset, wherein the mixed reality view includes virtual elements;
- tracking a gaze of the user during the rendering of the mixed reality view;
- during the rendering of the mixed reality view, capturing sensor data by the MR headset, and analyzing the sensor data to detect real-world objects in a local environment in which the MR headset is disposed;
- determining a risk to the user posed by one or more of the identified real-world objects;
- responsive to determining the risk, then adjusting an appearance of at least one virtual element;
- and,
- following the adjusting of the appearance, responsive to detecting the gaze of the user looking at the one or more of the identified real-world objects posing the risk, including detecting the gaze directed toward the one or more of the identified real-world objects for at least a predefined duration, then stopping the adjusting of the appearance of the at least one virtual element.
A non-transitory computer readable medium having program instructions embodied thereon that, when executed by at least one computing device, cause said at least one computing device to perform a method for providing a mixed reality (MR) experience, said method comprising:
- rendering a mixed reality view for a user on an MR headset, wherein the mixed reality view includes virtual elements;
- tracking a gaze of the user during the rendering of the mixed reality view;
- during the rendering of the mixed reality view, capturing sensor data by the MR headset, and analyzing the sensor data to detect real-world objects in a local environment in which the MR headset is disposed;
- determining a risk to the user posed by one or more of the identified real-world objects;
- responsive to determining the risk, then adjusting an appearance of at least one virtual element;
- and,
- following the adjusting of the appearance, responsive to detecting the gaze of the user looking at the one or more of the identified real-world objects posing the risk, including detecting the gaze directed toward the one or more of the identified real-world objects for at least a predefined duration, then stopping the adjusting of the appearance of the at least one virtual element.
Dependencies are inferred from the claim text.