# US 2021/0276570 A1 · Occupant behavior determining apparatus, occupant behavior determining method, and storage medium

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0276570 A1
- Document ID: US20210276570A1
- Status: Published application
- Kind: A1
- Application number: 17/190,940
- Filed: 2021-03-03
- Published: 2021-09-09
- Earliest claimed: 2020-03-05
- Assignees: Honda Motor Co., Ltd.
- Applicants: Honda Motor Co., Ltd.
- Inventors: Takashi KUSAKA; Yuki KAGIYA
- Web page: https://patentgrep.com/patent/US20210276570A1

## CPC

- B60W 40/09: Driving style or behaviour
- G06V 20/20: in augmented reality scenes
- G06V 20/597: {Recognising the driver's state or behaviour, e.g. attention or drowsiness}
- B60W 2540/225: Direction of gaze
- B60W 2540/229: Attention level, e.g. attentive to driving, reading or sleeping
- B60W 2540/30: Driving style
- G06V 40/16: Human faces, e.g. facial parts, sketches or expressions
- B60W: CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

An occupant behavior determining apparatus includes a surveillance camera that captures an image of an occupant of a vehicle to acquire an image; a face recognizing section that recognizes a face of the occupant based on the image; a posture recognizing section that recognizes a posture of the occupant based on the image; and a behavior determining section that determines a behavior of the occupant in a vehicle cabin based on a recognition result of the face recognizing section and a recognition result of the posture recognizing section.

## Claims

### Claim 1

An occupant behavior determining apparatus comprising:
a camera configured to capture an image of an occupant of a vehicle to acquire an image; and
one or more processors that execute computer-executable instructions stored in a memory, wherein
the one or more processors execute the computer-executable instructions to cause the occupant behavior determining apparatus to:
recognize a face of the occupant based on the image;
recognize a posture of the occupant based on the image; and
determine a behavior of the occupant in a vehicle cabin based on a recognition result of the face of the occupant and a recognition result of the posture of the occupant.

### Claim 2 (depends on 1)

The occupant behavior determining apparatus according to claim 1, wherein the one or more processors cause the occupant behavior determining apparatus to:
recognize an object held by the occupant based on the image; and
determine the behavior of the occupant based on the recognition result of the face of the occupant, the recognition result of the posture of the occupant, and a recognition result of the object held by the occupant.

### Claim 3 (depends on 1)

The occupant behavior determining apparatus according to claim 1, wherein the one or more processors cause the occupant behavior determining apparatus to:
recognize a nearby object that is close to the camera, based on the image;
generate, from the image, a high-resolution image having a relatively high resolution compared to a low-resolution image, and the low-resolution image having a relatively low resolution compared to the high-resolution image;
recognize the face of the occupant and the posture of the occupant based on the high-resolution image; and
recognize the nearby object based on the low-resolution image.

### Claim 4 (depends on 3)

The occupant behavior determining apparatus according to claim 3, wherein
the camera is provided near a manipulated device of the vehicle that is to be manipulated by a finger of the occupant, and
the one or more processors cause the occupant behavior determining apparatus to determine the behavior of the occupant to be manipulation of the manipulated device if the nearby object is recognized.

### Claim 5

An occupant behavior determining method, comprising:
recognizing a face of an occupant of a vehicle based on an image of the occupant captured by a camera;
recognizing a posture of the occupant based on the image; and
determining a behavior of the occupant in a vehicle cabin based on a recognition result of the face of the occupant and a recognition result of the posture of the occupant.

### Claim 6 (depends on 5)

The occupant behavior determining method according to claim 5, further comprising:
recognizing an object held by the occupant based on the image; and
determining the behavior of the occupant based on the recognition result of the face of the occupant, the recognition result of the posture of the occupant, and a recognition result of the object held by the occupant.

### Claim 7 (depends on 5)

The occupant behavior determining method according to claim 5, further comprising:
recognizing a nearby object that is close to the camera, based on the image;
generating, from the image, a high-resolution image having a relatively high resolution compared to a low-resolution image, and the low-resolution image having a relatively low resolution compared to the high-resolution image;
recognizing the face of the occupant and the posture of the occupant based on the high-resolution image; and
recognizing the nearby object based on the low-resolution image.

### Claim 8 (depends on 5)

The occupant behavior determining method according to claim 5, wherein
the camera is provided near a manipulated device of the vehicle that is to be manipulated by a finger of the occupant, and
the occupant behavior determining method further comprises determining the behavior of the occupant to be manipulation of the manipulated device if the nearby object is recognized.

### Claim 9

A non-transitory computer-readable storage medium storing a program for causing a computer to:
recognize a face of an occupant of a vehicle based on an image of the occupant captured by a camera;
recognize a posture of the occupant based on the image; and
determine a behavior of the occupant in a vehicle cabin based on a recognition result of the face of the occupant and a recognition result of the posture of the occupant.

### Claim 10 (depends on 9)

The non-transitory computer-readable storage medium according to claim 9, wherein the program further causes the computer to:
recognize an object held by the occupant based on the image; and
determine the behavior of the occupant based on the recognition result of the face of the occupant, the recognition result of the posture of the occupant, and a recognition result of the object held by the occupant.

### Claim 11 (depends on 9)

The non-transitory computer-readable storage medium according to claim 9, wherein the program further causes the computer to:
recognize a nearby object that is close to the camera, based on the image;
generate, from the image, a high-resolution image having a relatively high resolution compared to a low-resolution image, and the low-resolution image having a relatively low resolution compared to the high-resolution image;
recognize the face of the occupant and the posture of the occupant based on the high-resolution image; and
recognize the nearby object based on the low-resolution image.
