US 12,762,869 B2 · Image-based three-dimensional occupant assessment for in-cabin monitoring systems and applications

Abstract

In various examples, image-based three-dimensional occupant assessment for in-cabin monitoring systems and applications are provided. An evaluation function may determine a 3D representation of an occupant of a machine by evaluating sensor data comprising an image frame from an optical image sensor. The 3D representation may comprise at least one characteristic representative of a size of the occupant, (e.g., a 3D pose and/or 3D shape), which may be used to derive other characteristics such as, but not limited to weight, height, and/or age. A first processing path may generate a representation of one or more features corresponding to at least a portion of the occupant based on optical image data, and a second processing path may determine a depth corresponding to the one or more features based on depth data derived from the optical image data and ground truth depth data corresponding to the interior of the machine.

Claims20

Dependent claims

A system comprising:

one or more processing units comprising circuitry to:
detect one or more features representing at least a portion of an occupant of a machine based at least on two-dimensional optical image data;
determine a depth corresponding to the one or more features based at least on the optical image data and a ground truth cabin depth image corresponding to an interior of the machine;
generate a three-dimensional representation of the occupant based at least on the one or more features and the depth of the one or more features, wherein the three-dimensional representation comprises at least one characteristic representative of a size of the occupant;
and
control at least one operation of the machine based at least on the at least one characteristic.

3 more elements

A processor comprising:

one or more processing units comprising circuitry to:
generate a first representation of at least a portion of an occupant of a machine based at least on two-dimensional optical image data;
determine a depth corresponding to one or more surface locations of the occupant based at least on the two-dimensional optical image data and a ground truth cabin depth image corresponding to an interior of the machine;
scale the first representation of at least the portion of the occupant to a second representation of at least the portion of the occupant based at least on the depth corresponding to the one or more surface locations of the occupant, wherein the second representation is a three-dimensional representation;
determine at least one characteristic representative of a size of the occupant based at least on the second representation;
and
control at least one operation of the machine based at least on the at least one characteristic of the size of the occupant.

4 more elements

Dependencies are inferred from the claim text.

Image-based three-dimensional occupant assessment for in-cabin monitoring systems and applications

Life of this patent

Image-based three-dimensional occupant assessment for in-cabin monitoring systems and applications

Life of this patent

Abstract

Claims20