Back to results
US 2021/0078408 A1Published application
System and method for correlating user attention direction and outside view
AssigneeXevo Inc.
InventorJohn P. Cordell
Life of this patent
Estimating the term…
Abstract
Embodiments are directed towards providing a system that presents customized content to a user of an automobile based on what the user of the automobile is looking at. A first camera captures images of the user of the interior of the automobile, and a second camera captures images of a scene that the user is viewing. The images are analyzed to determine if the user is looking at, or not looking at, an object in the scene. If the user is looking at such an object, content associated with the object is selected and presented to the user.
Claims20
A system, comprising:
- an output interface that is configured to present content to a person in a vehicle;
- a first camera that is configured to capture a plurality of first images of the person;
- a second camera that is configured to capture a plurality of second images of a scene that the person is viewing in front of the vehicle;
- a memory that is configured to store computer instructions;
- a processor that is configured to execute the computer instructions to:
- obtain the first plurality of images captured by the first camera;
- obtain the second plurality of images captured by the second camera;
- determine, from a plurality of attention levels, an attention level of the person in an object of interest in the scene in which the person is looking at based on an analysis of an attention position of the person in the plurality of first images and an analysis of a relative position of the object of interest the plurality of second images;
- determine a type of content from a plurality of types of content based on the determined attention level;
- select an item of content to present to the person based on the determined type of content and the object of interest that the person is looking at;
- and
- present the selected item of content to the person via the output interface.
9 more elements
A method, comprising:
- capturing a first plurality of images of a person in a vehicle and a plurality of second images of an area viewable by the person;
- determining, from a plurality of attention levels, an attention level of the person in an object of interest in the scene in which the person is looking at based on an analysis of an attention position of the person in the plurality of first images and an analysis of a relative position of the object of interest the plurality of second images;
- determining a type of content from a plurality of types of content based on the determined attention level, wherein each attention level of the plurality of attention levels corresponds to a different type of content of the plurality of types of content;
- selecting an item of content to present to the person based on the determined type of content and the object of interest that the person is looking at;
- and
- presenting the selected item of content to the person via the output interface.
3 more elements
A head unit of an automobile, comprising:
- a display device that is configured to display visual content;
- a memory that is configured to store computer instructions;
- and
- a processor that, when executing the computer instructions, causes the head unit to:
- receive a first plurality of images from an interior-facing camera on the automobile;
- receive a second plurality of images from an exterior-facing camera on the automobile;
- determine a focus of a user in the automobile on an object of interest based on a direction of the user's attention detected from the plurality of first images and a relative position of the object of interest detected from the plurality of second images;
- determine, from a plurality of attention levels, an attention level of the user in the object of interest based on the determined focus of the user;
- determine a type of content from a plurality of types of content based on the determined attention level;
- select an item of content to present to the user based on the determined type of content and the object of interest that the user is focusing on;
- and
- provide the selected item of content to the user via the display device.
9 more elements
Dependencies are inferred from the claim text.