# US 2023/0054024 A1 · Information processing apparatus, information processing system, information processing method, and information processing program

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0054024 A1
- Document ID: US20230054024A1
- Status: Published application
- Kind: A1
- Application number: 17/791,844
- Filed: 2020-12-17
- Published: 2023-02-23
- Earliest claimed: 2020-01-17
- Assignees: Sony Semiconductor Solutions Corporation
- Applicants: Sony Semiconductor Solutions Corporation
- Inventors: Eiji Oba; Kohei Kadoshita
- Web page: https://patentgrep.com/patent/US20230054024A1

## CPC

- A61B 5/1114: {Tracking parts of the body}
- B60W 60/0053: {from vehicle to occupant}
- A61B 3/113: for determining or recording eye movement
- A61B 5/0077: {Devices for viewing the surface of the body, e.g. camera, magnifying lens}
- A61B 5/165: {Evaluating the state of mind, e.g. depression, anxiety}
- A61B 5/18: for vehicle drivers {or machine operators}
- A61B 5/4809: {Sleep detection, i.e. determining whether a subject is asleep or not}
- A61B 5/7282: {Event detection, e.g. detecting unique waveforms indicative of a medical condition (cough events A61B5/0823; seizures A61B5/4094; sleep apnoea A61B5/4818)}
- B60W 40/08: related to drivers or passengers
- B60W 50/082: {Selecting or switching between different modes of propelling}
- B60W 60/0059: {Estimation of the risk associated with autonomous or manual driving, e.g. situation too complex, sensor failure or driver incapacity}
- H04W 4/38: for collecting sensor information
- H04W 4/48: for in-vehicle communication
- B60W 60/00: Drive control systems specially adapted for autonomous road vehicles
- B60W 2040/0818: {Inactivity or incapacity of driver}
- B60W 2040/0827: {due to sleepiness}
- B60W 2540/00: Input parameters relating to occupants
- B60W 2540/223: Posture, e.g. hand, foot, or seat position, turned or inclined
- B60W 2540/225: Direction of gaze
- B60W 2556/40: High definition maps
- G08G 1/166: {for active traffic, e.g. moving vehicles, pedestrians, bikes}
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)
- B60W: CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- H04W: WIRELESS COMMUNICATION NETWORKS (broadcast communication H04H; communication systems using wireless links for non-selective communication, e.g. wireless extensions H04M1/72)
- G08G: TRAFFIC CONTROL SYSTEMS (guiding railway traffic, ensuring the safety of railway traffic B61L; arrangement of road signs or traffic signals E01F9/00; radar or analogous systems, sonar systems, lidar systems specially adapted for traffic control G01S13/91, G01S15/88, G01S17/88; {radar or analogous systems, sonar systems, lidar systems specially adapted for anti-collision purposes G01S13/93, G01S15/93, G01S17/93})

## Abstract

There is provided an information processing apparatus including an eyeball behavior analysis unit (300) that analyzes an eyeball behavior of a driver who drives a moving object, in which the eyeball behavior analysis unit dynamically switches an analysis mode according to a driving mode of the moving object.

## Claims

### Claim 1

An information processing apparatus comprising:
an eyeball behavior analysis unit that analyzes an eyeball behavior of a driver who drives a moving object,
wherein the eyeball behavior analysis unit dynamically switches an analysis mode according to a driving mode of the moving object.

### Claim 2 (depends on 1)

The information processing apparatus according to claim 1, wherein the eyeball behavior includes at least one of a saccade, a fixation, or a microsaccade of an eyeball.

### Claim 3 (depends on 1)

The information processing apparatus according to claim 1, wherein the eyeball behavior analysis unit
performs switching between at least a first analysis mode and a second analysis mode,
performs analysis at a first frame rate in the first analysis mode, and
performs analysis at a second frame rate lower than the first frame rate in the second analysis mode.

### Claim 4 (depends on 3)

The information processing apparatus according to claim 3, wherein the eyeball behavior analysis unit performs analysis in the first analysis mode, in a driving mode change preparation mode in which the driving mode of the moving object is switched from an autonomous driving mode to a manual driving mode.

### Claim 5 (depends on 4)

The information processing apparatus according to claim 4, wherein a start point of the first analysis mode is determined on a basis of at least one of a schedule, a local dynamic map, or state information of the driver.

### Claim 6 (depends on 4)

The information processing apparatus according to claim 4, further comprising: a determination unit that determines a return correspondence level to manual driving of the driver on a basis of an analysis result of an eyeball behavior of the driver in the first analysis mode.

### Claim 7 (depends on 6)

The information processing apparatus according to claim 6, wherein the determination unit determines the return correspondence level by comparing the analysis result of the eyeball behavior of the driver in the first analysis mode with an analysis result of the eyeball behavior of the driver that is previously acquired.

### Claim 8 (depends on 7)

The information processing apparatus according to claim 7, further comprising: a learning device that generates a database for the determination by learning the analysis result of the eyeball behavior of the driver that is previously acquired.

### Claim 9 (depends on 6)

The information processing apparatus according to claim 6, further comprising: a moving object driving control unit that switches the driving mode of the moving object on a basis of a determination result of the return correspondence level.

### Claim 10 (depends on 4)

The information processing apparatus according to claim 4, wherein the eyeball behavior analysis unit performs analysis in the second analysis mode in a case where the driving mode of the moving object is the autonomous driving mode.

### Claim 11 (depends on 10)

The information processing apparatus according to claim 10, wherein the eyeball behavior analysis unit dynamically switches an analysis frequency according to an autonomous driving level in the autonomous driving mode.

### Claim 12 (depends on 4)

The information processing apparatus according to claim 4, wherein the eyeball behavior analysis unit performs analysis in the first analysis mode or the second analysis mode in a case where the driving mode of the moving object is the manual driving mode.

### Claim 13 (depends on 4)

The information processing apparatus according to claim 4, wherein the eyeball behavior analysis unit performs analysis in the first analysis mode according to lowering of an awakening level of the driver.

### Claim 14

An information processing system comprising:
an eyeball behavior analysis unit that analyzes an eyeball behavior of a driver who drives a moving object,
wherein the eyeball behavior analysis unit dynamically switches an analysis mode according to a driving mode of the moving object.

### Claim 15 (depends on 14)

The information processing system according to claim 14, further comprising: a monitoring unit that monitors the eyeball behavior of the driver.

### Claim 16

An information processing method comprising:
analyzing, via an eyeball behavior analysis unit, an eyeball behavior of a driver who drives a moving object,
wherein an analysis mode of the analysis is dynamically switched according to a driving mode of the moving object.

### Claim 17

An information processing program causing a computer to execute:
an analysis function of analyzing an eyeball behavior of a driver who drives a moving object,
wherein an analysis mode of the analysis function is dynamically switched according to a driving mode of the moving object.
