# US 2024/0005677 A1 · Electronic device, information processing apparatus, degree-of-concentration calculation program, and degree-of-concentration calculation method

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0005677 A1
- Document ID: US20240005677A1
- Status: Published application
- Kind: A1
- Application number: 18/255,564
- Filed: 2021-12-01
- Published: 2024-01-04
- Earliest claimed: 2020-12-03
- Assignees: KYOCERA Corporation
- Applicants: KYOCERA Corporation
- Inventors: Takayuki SHINOZAKI
- Web page: https://patentgrep.com/patent/US20240005677A1

## CPC

- G06T 7/20: Analysis of motion (motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51)
- G06V 20/597: {Recognising the driver's state or behaviour, e.g. attention or drowsiness}
- B60W 40/08: related to drivers or passengers
- G06T 7/00: Image analysis
- G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80)
- G06V 10/776: Validation; Performance evaluation
- B60W 2540/225: Direction of gaze
- G06T 2207/10016: Video; Image sequence
- G06T 2207/20076: Probabilistic image processing
- G06T 2207/20081: Training; Learning
- G06T 2207/20084: Artificial neural networks [ANN]
- G06T 2207/30196: Human being; Person
- G06T 2207/30268: Vehicle interior
- G08G 1/166: {for active traffic, e.g. moving vehicles, pedestrians, bikes}
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- B60W: CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- G08G: TRAFFIC CONTROL SYSTEMS (guiding railway traffic, ensuring the safety of railway traffic B61L; arrangement of road signs or traffic signals E01F9/00; radar or analogous systems, sonar systems, lidar systems specially adapted for traffic control G01S13/91, G01S15/88, G01S17/88; {radar or analogous systems, sonar systems, lidar systems specially adapted for anti-collision purposes G01S13/93, G01S15/93, G01S17/93})

## Abstract

An electronic device 10 includes an image-capturing unit 11, a line-of-sight detector 12, and a controller 14. The image-capturing unit 11 generates an image corresponding to a view by performing image capturing. The line-of-sight detector 12 detects a line of sight of a subject with respect to the view. The controller 14 determines, based on the image, the reliability of the image as a source of estimation of the degree of concentration of the subject. The controller 14 estimates the degree of concentration of the subject based on the reliability, the image, and the line of sight.

## Claims

### Claim 1

An electronic device comprising:
an image-capturing unit configured to generate an image corresponding to a view by performing image capturing;
a line-of-sight detector configured to detect a line of sight of a subject with respect to the view; and
a controller configured to determine, based on the image, a reliability of the image as a source of estimation of a degree of concentration of the subject and configured to estimate the degree of concentration of the subject based on the reliability, the image, and the line of sight.

### Claim 2 (depends on 1)

The electronic device according to claim 1,
wherein the controller stops estimation of the degree of concentration when the reliability is less than or equal to a reliability threshold.

### Claim 3 (depends on 2)

The electronic device according to claim 2,
wherein the controller lowers the reliability threshold as a time for which estimation of the degree of concentration is stopped becomes longer.

### Claim 4 (depends on 1)

The electronic device according to claim 1,
wherein the controller estimates the degree of concentration of the subject based on the images of a greater number of frames, the lower the reliability, the images being consecutively captured.

### Claim 5 (depends on 1)

The electronic device according to claim 1,
wherein the controller determines the reliability by calculating the reliability based on at least one out of a type, a number, and a position of an element included in the image.

### Claim 6 (depends on 5)

The electronic device according to claim 5,
wherein the element may be any one out of a vehicle, a pedestrian, road geometry, a sign, a signal, and an optical flow.

### Claim 7 (depends on 1)

The electronic device according to claim 1,
wherein the controller determines the reliability by estimating the reliability based on the image, a relationship between the learning image and information on the reliability being constructed using machine-learned learning data.

### Claim 8

An information processing apparatus comprising:
an acquiring unit configured to acquire an image corresponding to a view and a line of sight of a subject to the view;
a controller configured to determine, based on the image, a reliability of the image as a source of estimation of a degree of concentration of the subject and configured to estimate the degree of concentration of the subject based on the reliability, the image, and the line of sight; and
an output unit configured to output the degree of concentration.

### Claim 9

A non-transitory computer-readable recording medium including a degree-of-concentration calculation program configured to cause a computer to function as:
an image-capturing unit configured to generate an image corresponding to a view by performing image capturing;
a line-of-sight detector configured to detect a line of sight of a subject with respect to the view; and
a controller configured to determine, based on the image, a reliability of the image as a source of estimation of a degree of concentration of the subject and configured to estimate the degree of concentration of the subject based on the reliability, the image, and the line of sight.

### Claim 10

A degree-of-concentration calculation method comprising:
generating an image corresponding to a view by performing image capturing,
detecting a line of sight of a subject to the view;
determining, based on the image, a reliability of the image as a source of estimation of a degree of concentration of the subject; and
estimating the degree of concentration of the subject based on the reliability, the image, and the line of sight.
