3D skeleton detection for in-cabin automotive application
AssigneeGentex Corporation
InventorsBar Mayo, Guy Raz
Life of this patent
Estimating the term…
Abstract
A monitoring system for a vehicle includes at least one imaging device configured to capture a first image type and a second image type in a sequence. A first illumination source is configured to emit a flood illumination captured by the at least one imaging device in the first image type. A second illumination source is configured to emit an illumination pattern captured by the at least one imaging device in the second image type. At least one processor is configured to extract a 2-dimensional (“2D”) skeletal representation of a vehicle occupant from the first image type, measure a depth of the 2D skeletal representation with the second image type, and extrapolate a 3-dimensional (“3D”) skeletal representation of the vehicle occupant.
Claims20
A monitoring system for a vehicle comprising:
- at least one imaging device configured to capture a first image type and a second image type in a sequence;
- a first illumination source configured to emit a flood illumination captured by the at least one imaging device in the first image type;
- a second illumination source configured to emit an illumination pattern captured by the at least one imaging device in the second image type;
- and
- at least one processor configured to:
- extract a 2-dimensional (“2D”) skeletal representation of a vehicle occupant from the first image type;
- measure a depth of the 2D skeletal representation with the second image type;
- and
- extrapolate a 3-dimensional (“3D”) skeletal representation of the vehicle occupant.
A monitoring system for a vehicle comprising:
- at least one imaging device configured to capture a first image type and a second image type;
- the first image type including a 2-dimensional (“2D”) capture of a flood illumination on a vehicle occupant;
- the second image type including depth information of the vehicle occupant;
- and
- at least one processor configured to:
- extract a 2-dimensional (“2D”) skeletal representation of a vehicle occupant from the first image type;
- measure a depth of the 2D skeletal representation with the depth information;
- extrapolate a 3-dimensional (“3D”) skeletal representation of the vehicle occupant;
- detect when a hand of the 3D skeletal representation of the vehicle occupant is in a gesture position;
- recognize a first hand gesture of the hand;
- and
- generate a menu in accordance with the first hand gesture.
A monitoring system for a vehicle comprising:
- at least one imaging device configured to capture a first image type and a second image type;
- the first image type including a 2-dimensional (“2D”) capture of a flood illumination on a vehicle occupant;
- the second image type including depth information of the vehicle occupant;
- and
- at least one processor configured to:
- extract a 2-dimensional (“2D”) skeletal representation of a vehicle occupant from the first image type;
- measure a depth of the 2D skeletal representation with the depth information;
- extrapolate a 3-dimensional (“3D”) skeletal representation of the vehicle occupant;
- detect when a hand of the 3D skeletal representation of the vehicle occupant is in a gesture position within a threshold distance of the at least one imaging device;
- recognize a first hand gesture of the hand;
- and
- generate a menu on a full display rearview mirror assembly in accordance with the first hand gesture.
Dependencies are inferred from the claim text.