US 12,675,918 B2 · Capturing and processing content for in-vehicle and extended display, curated journaling, and real-time assistance during vehicular travel

Abstract

Methods and systems are described for imaging and content generation. During a road trip, a driver or passenger observes an object or scene from a vehicle. From a perspective of the driver or passenger, the object or scene flows out of view in a relatively short amount of time. Images and video of the object or scene are captured with cameras. A field of view is extended beyond what the driver or passenger can easily observe. The capture is configurable to focus on particular types of objects or scenes. Recordings of billboards and road signs are easily displayed after passing the object. Object identification, gaze determination, and interest determination are provided. Curated content is generated. Applications to extended reality environments are provided. Artificial intelligence systems, including neural networks, and models are utilized to improve the imaging and content generation. Related apparatuses, devices, techniques, and articles are also described.

Claims20

Dependent claims

A method for controlling media acquisition by an imaging device, the imaging device positioned to capture media external to a vehicle, the method comprising:

instructing the imaging device to acquire the media;
identifying an object in the acquired media;
determining whether the identified object visually conveys information;
determining whether the information is of interest to a person in the vehicle;
and
in response to determining the information is of interest to the person in the vehicle:
generating content related to the identified object, wherein:
the related content comprises an image overlay to be displayed on a smart rear-view mirror and display (SRVMD) of the vehicle,
the image overlay comprises an inverted view of the identified object, and
the inverted view is generated based on one or more images of the identified object captured by one or more front-facing cameras;
and
generating the related content for display on the SRVMD of the vehicle.

9 more elements

A system for controlling media acquisition by an imaging device, the imaging device positioned to capture media external to a vehicle, and a display device, the system comprising:

control circuitry configured to:
instruct the imaging device to acquire the media;
identify an object in the acquired media;
determine whether the identified object visually conveys information;
determine whether the information is of interest to a person in the vehicle;
and
in response to determining the information is of interest to the person in the vehicle:
generate content related to the identified object, wherein:
the related content comprises an image overlay to be displayed on a smart rear-view mirror and display (SRVMD) of the vehicle,
the image overlay comprises an inverted view of the identified object, and
the inverted view is generated based on one or more images of the identified object captured by one or more front-facing cameras;
and
generate the related content for display on the SRVMD of the vehicle.

10 more elements

Dependencies are inferred from the claim text.

Capturing and processing content for in-vehicle and extended display, curated journaling, and real-time assistance during vehicular travel

Life of this patent

Capturing and processing content for in-vehicle and extended display, curated journaling, and real-time assistance during vehicular travel

Life of this patent

Abstract

Claims20