Occlusion classification and feedback
AssigneeApple Inc.
InventorsBrett D. Miller, Daniel K. Boothe, Martin E. Johnson
Life of this patent
Estimating the term…
Abstract
In one implementation, a method of detecting an occlusion of an image sensor is performed at a device including one or more image sensors, one or more speakers, one or more processors, and non-transitory memory. The method includes receiving, from the one or more image sensors, an image of a physical environment. The method includes detecting, based on the image of the physical environment, an occlusion at least partially occluding the one or more image sensors. The method includes classifying the occlusion as one of a plurality of occlusion types. The method includes playing, via the one or more speakers, an occlusion notification based on the classification.
Claims20
A method comprising:
- at a device including one or more image sensors, one or more speakers, one or more processors, and non-transitory memory:
- receiving, from the one or more image sensors, an image of a physical environment;
- detecting, based on the image of the physical environment, an occlusion at least partially occluding the one or more image sensors;
- classifying the occlusion as one of a plurality of occlusion types, wherein the one or more image sensors includes a left image sensor and a right image sensor and the plurality of occlusion types includes a left image sensor occlusion type associated with occlusion of the left image sensor and a right image sensor occlusion type associated with occlusion of the right image sensor;
- and
- playing, via the one or more speakers, an occlusion notification based on the classification, wherein the one or more speakers includes a left speaker and a right speaker and playing the occlusion notification based on the classification includes playing the occlusion notification in one of the left speaker or the right speaker.
A non-transitory memory storing one or more programs, which, when executed by one or more processors of a device including one or more image sensors and one or more speakers cause the device to:
- receive, from the one or more image sensors, an image of a physical environment;
- detect, based on the image of the physical environment, an occlusion at least partially occluding the one or more image sensors;
- classify the occlusion as one of a plurality of occlusion types, wherein the one or more image sensors includes a left image sensor and a right image sensor and wherein the plurality of occlusion types includes a left image sensor occlusion type associated with occlusion of the left image sensor and a right image sensor occlusion type associated with occlusion of the right image sensor;
- and
- play, via the one or more speakers, an occlusion notification based on the classification, wherein the one or more speakers includes a left speaker and a right speaker and wherein playing the occlusion notification based on the classification includes playing the occlusion notification in one of the left speaker or the right speaker.
A device comprising:
- one or more image sensors;
- one or more speakers;
- a non-transitory memory;
- and
- one or more processors to:
- receive, from the one or more image sensors, an image of a physical environment;
- detect, based on the image of the physical environment, an occlusion at least partially occluding the one or more image sensors;
- classify the occlusion as one of a plurality of occlusion types, wherein the one or more image sensors includes a left image sensor and a right image sensor and wherein the plurality of occlusion types includes a left image sensor occlusion type associated with occlusion of the left image sensor and a right image sensor occlusion type associated with occlusion of the right image sensor;
- and
- play, via the one or more speakers, an occlusion notification based on the classification, wherein the one or more speakers includes a left speaker and a right speaker and wherein playing the occlusion notification based on the classification includes playing the occlusion notification in one of the left speaker or the right speaker.
Dependencies are inferred from the claim text.