# US 2021/0275072 A1 · Method for predicting arousal level and arousal level prediction apparatus

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0275072 A1
- Document ID: US20210275072A1
- Status: Published application
- Kind: A1
- Application number: 17/328,699
- Filed: 2021-05-24
- Published: 2021-09-09
- Earliest claimed: 2015-07-22
- Assignees: Panasonic Intellectual Property Corporation of America
- Applicants: Panasonic Intellectual Property Corporation of America
- Inventors: Koichi KUSUKAME; Shinichi SHIKII; Kazuki FUNASE
- Web page: https://patentgrep.com/patent/US20210275072A1

## CPC

- A61B 5/18: for vehicle drivers {or machine operators}
- A61B 5/01: Measuring temperature of body parts {; Diagnostic temperature sensing, e.g. for malignant or inflamed tissue} (clinical contact thermometers G01K13/20)
- A61B 5/024: Measuring pulse rate or heart rate
- A61B 5/02405: {Determining heart rate variability}
- A61B 5/02444: {Details of sensor (A61B5/02427 takes precedence)}
- A61B 5/026: Measuring blood flow {(A61B3/1233, A61B3/1241 take precedence)}
- A61B 5/0295: using plethysmography, i.e. measuring the variations in the volume of a body part as modified by the circulation of blood therethrough, e.g. impedance plethysmography
- A61B 5/0816: {Measuring devices for examining respiratory frequency (measuring frequency of electric signals G01R23/00)}
- A61B 5/0878: {using temperature sensing means}
- A61B 5/1118: {Determining activity level}
- A61B 5/14551: {for measuring blood gases}
- A61B 5/165: {Evaluating the state of mind, e.g. depression, anxiety}
- A61B 5/4806: {Sleep evaluation (A61B5/4821 takes precedence; devices for inducing sleep A61M21/02)}
- A61B 5/486: {Biofeedback (using electroencephalography [EEG] A61B5/375)}
- A61B 5/7275: {Determining trends in physiological measurement data; Predicting development of a medical condition based on physiological measurements, e.g. determining a risk factor}
- A61M 21/00: Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis
- B60H 1/00742: {by detection of the vehicle occupants' presence; by detection of conditions relating to the body of occupants, e.g. using radiant heat detectors}
- B60K 28/06: responsive to incapacity of driver
- G06F 3/165: {Management of the audio stream, e.g. setting of volume, audio stream path}
- G08B 21/06: indicating a condition of sleep, e.g. anti-dozing alarms
- G16H 40/60: for the operation of medical equipment or devices
- G16H 40/63: for local operation
- G16H 40/67: for remote operation
- G16H 50/20: for computer-aided diagnosis, e.g. based on medical expert systems
- G16H 50/30: for calculating health indices; for individual health risk assessment
- G16H 50/50: for simulation or modelling of medical disorders
- A61B 3/113: for determining or recording eye movement
- A61B 5/02416: {using photoplethysmograph signals, e.g. generated by infrared radiation (A61B5/14552 takes precedence)}
- A61B 5/0261: {using optical means, e.g. infrared light}
- A61B 5/0285: Measuring or recording phase velocity of blood waves
- A61B 5/091: Measuring volume of inspired or expired gases, e.g. to determine lung capacity
- A61B 5/1032: {Determining colour of tissue for diagnostic purposes}
- A61B 5/7278: {Artificial waveform generation or derivation, e.g. synthesizing signals from measured signals}
- A61B 2503/22: Motor vehicles operators, e.g. drivers, pilots, captains
- A61B 2503/24: Computer workstation operators
- A61B 2560/0242: adapted to measure environmental factors, e.g. temperature, pollution
- A61M 2021/0027: {by the hearing sense}
- A61M 2021/0044: {by the sight sense}
- A61M 2021/0066: {with heating or cooling}
- A61M 2021/0083: {especially for waking up}
- A61M 2205/3303: Using a biosensor
- B60H 1/0073: {Control systems or circuits characterised by particular algorithms or computational models, e.g. fuzzy logic or dynamic models}
- B60H 1/00771: {the input being a vehicle position or surrounding, e.g. GPS-based position or tunnel}
- B60K 35/28: characterised by the type of the output information, e.g. video entertainment or vehicle dynamics information; characterised by the purpose of the output information, e.g. for attracting the attention of the driver
- G04F 10/00: Apparatus for measuring unknown time intervals by electric means
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)
- A61M: DEVICES FOR INTRODUCING MEDIA INTO, OR ONTO, THE BODY (introducing media into or onto the bodies of animals A61D7/00; means for inserting tampons A61F13/26; devices for administering food or medicines orally A61J; containers for collecting, storing or administering blood or medical fluids A61J1/05); DEVICES FOR TRANSDUCING BODY MEDIA OR FOR TAKING MEDIA FROM THE BODY (surgery A61B; chemical aspects of surgical articles A61L); DEVICES FOR PRODUCING OR ENDING SLEEP OR STUPOR {(Electrotherapy, e.g. producing anaesthesia by the use of alternating or intermittent currents A61N1/36021)}
- B60H: ARRANGEMENTS OF HEATING, COOLING, VENTILATING OR OTHER AIR-TREATING DEVICES SPECIALLY ADAPTED FOR PASSENGER OR GOODS SPACES OF VEHICLES
- B60K: ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G08B: SIGNALLING SYSTEMS, e.g. PERSONAL CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G16H: HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G04F: TIME-INTERVAL MEASURING (measuring pulse characteristics G01R, e.g. G01R29/02; in radar or like systems G01S)

## Abstract

A method for predicting an arousal level used by a computer of an arousal level prediction apparatus that predicts an arousal level of a user is provided. The method includes obtaining current biological information regarding the user detected by a sensor, and calculating a current arousal level of the user based on the current biological information. The method further includes obtaining current environment information indicating a current environment around the user, and predicting a future arousal level, which is an arousal level a certain period of time later, based on the current arousal level and the current environment information. Based on the predicted future arousal level, the method further issues a notification to the user, or controls an operation of a device.

## Claims

### Claim 1

A method for predicting an arousal level used by a computer of an arousal level prediction apparatus that predicts an arousal level of a user, the method comprising:
obtaining, by a processor of the computer, current biological information regarding the user detected by a sensor;
calculating, by the processor, a current arousal level of the user based on the current biological information;
obtaining, by the processor, current environment information indicating a current environment around the user, wherein the current environment information includes at least one of (i) an information piece indicating a current illumination around the user, (ii) an information piece indicating a current wind speed around the user, (iii) an information piece indicating a current CO2 concentration around the user, (iv) an information piece indicating a current vibration around the user, (v) an information piece indicating a current ambient temperature around the user, and (vi) an information piece indicating a current ambient temperature distribution around the user;
predicting, by the processor, a future arousal level, which is an arousal level a certain period of time later, based on the current arousal level and the current environment information; and
performing, by the processor, either of:
issuing a notification to the user, or
controlling a first device, based on the future arousal level.

### Claim 2 (depends on 1)

The method according to claim 1,
wherein, in the predicting of the future arousal level, a rate of decrease in an arousal level is estimated based on how likely it is for a person to become drowsy as indicated by the current environment information, and
wherein the future arousal level is predicted by correcting the current arousal level to the arousal level the certain period of time later using the rate of decrease.

### Claim 3 (depends on 1)

The method according to claim 1,
wherein the issuing or the controlling is performed only if the future arousal level is lower than a certain threshold.

### Claim 4 (depends on 1)

The method according to claim 1,
wherein the arousal level prediction apparatus is mounted on an automobile, and
wherein the certain period of time is included in a time taken to arrive at a target destination, the target destination being inputted by the user to a navigation system installed in the automobile.

### Claim 5 (depends on 1)

The method according to claim 1,
wherein the biological information includes information indicating a heart rate, and
wherein the current arousal level becomes lower as a current heart rate of the user becomes lower.

### Claim 6 (depends on 5)

The method according to claim 5,
wherein the sensor detects the current heart rate of the user using any of a milliwave sensor, a pulse oximeter, a speckle camera, and a laser Doppler velocimeter.

### Claim 7 (depends on 1)

The method according to claim 1,
wherein the biological information includes information indicating a respiratory rate or an amount of air breathed, and
wherein the current arousal level becomes lower as a current respiratory rate of the user becomes lower or a current amount of air breathed by the user becomes smaller.

### Claim 8 (depends on 7)

The method according to claim 7,
wherein the sensor detects the current respiratory rate of the user or the current amount of air breathed by the user by measuring a change in a color of the user's skin using a photodiode.

### Claim 9 (depends on 7)

The method according to claim 7,
wherein the sensor detects the current respiratory rate of the user or the current amount of air breathed by the user by measuring a current temperature of the user's lips or a portion under the user's nose using a radiation thermometer.

### Claim 10 (depends on 1)

The method according to claim 1,
wherein the biological information includes information indicating a body surface temperature of a periphery of the user's body and a deep-body temperature of the user's body, and
wherein the current arousal level becomes lower as a current body surface temperature of the periphery of the user's body becomes closer to the deep-body temperature of the user's body.

### Claim 11 (depends on 1)

The method according to claim 1,
wherein the biological information includes information indicating a blood flow volume in a periphery of the user's body, and
wherein the current arousal level becomes lower as a current blood flow volume in a periphery of the user's body becomes larger.

### Claim 12 (depends on 11)

The method according to claim 11,
wherein the sensor detects the current blood flow volume in the periphery of the user's body by measuring blood flow distribution of the user using a laser speckle camera.

### Claim 13 (depends on 2)

The method according to claim 2,
wherein the current environment information includes the information piece indicating the current illumination around the user, and
wherein the rate of decrease in the arousal level becomes higher as the current illumination becomes lower.

### Claim 14 (depends on 2)

The method according to claim 2,
wherein the current environment information includes the information piece indicating the current wind speed around the user, and
wherein a higher rate of decrease in the arousal level is estimated as the current wind speed becomes lower.

### Claim 15 (depends on 2)

The method according to claim 2,
wherein the current environment information includes the information piece indicating the current CO2 concentration around the user, and
wherein a higher rate of decrease in the arousal level is estimated as the current CO2 concentration becomes higher.

### Claim 16 (depends on 2)

The method according to claim 2,
wherein the current environment information includes the information piece indicating the current vibration around the user, and
wherein a higher rate of decrease in the arousal level is estimated as a current vibration speed becomes higher.

### Claim 17 (depends on 2)

The method according to claim 2,
wherein the current environment information includes the information piece indicating the current ambient temperature around the user, and
wherein a higher rate of decrease in the arousal level is estimated as the current ambient temperature becomes higher.

### Claim 18 (depends on 2)

The method according to claim 2,
wherein the current environment information includes the information piece indicating the current ambient temperature around the user, and
wherein the rate of decrease in the arousal level becomes lower as a value obtained by subtracting a temperature around a hand or a foot of the user from a temperature around a chest or an abdomen of the user becomes larger.

### Claim 19 (depends on 1)

The method according to claim 1, further comprising:
obtaining, by the processor, sleep information indicating hours of sleep of the user of a previous day; and
predicting, by the processor, the future arousal level based on the current arousal level, the current environment information, and the sleep information.

### Claim 20 (depends on 1)

The method according to claim 1, further comprising:
obtaining, by the processor, past sleep information indicating hours of sleep of the user in a certain period of time in past; and
predicting, by the processor, the future arousal level based on the current arousal level, the current environment information, and the past sleep information.

### Claim 21 (depends on 1)

The method according to claim 1, further comprising:
obtaining, by the processor, information indicating an activity history of the user; and
predicting, by the processor, the future arousal level based on the current arousal level, the current environment information, and the activity history.

### Claim 22 (depends on 1)

The method according to claim 1, further comprising:
controlling a second device, which is different from the first device, based on the future arousal level,
wherein the second device is an air conditioner installed in a same space in which the arousal level prediction apparatus is installed, and
wherein setting temperature or air volume of the air conditioner is changed if the future arousal level is lower than a certain threshold.

### Claim 23 (depends on 1)

The method according to claim 1, further comprising:
controlling a second device, which is different from the first device, based on the future arousal level,
wherein the second device is a lighting device installed in a same space in which the arousal level prediction apparatus is installed, and
wherein brightness of the lighting device is increased if the future arousal level is lower than a certain threshold.

### Claim 24 (depends on 1)

The method according to claim 1, further comprising:
controlling a second device, which is different from the first device, based on the future arousal level,
wherein the second device is a personal computer including a display used by the user, and
wherein a color or luminance of the display of the personal computer is changed if the future arousal level is lower than a certain threshold.

### Claim 25

An arousal level prediction apparatus, comprising:
a first sensor that detects current biological information of a user;
a second sensor that detects current environment information indicating a current environment around the user, wherein the current environment information includes at least one of (i) an information piece indicating current illumination around the user, (ii) an information piece indicating a current wind speed around the user, (iii) an information piece indicating a current CO2 concentration around the user, (iv) an information piece indicating a current vibration around the user, (v) an information piece indicating a current ambient temperature around the user, and (vi) an information piece indicating a current ambient temperature distribution around the user;
a processor
that calculates a current arousal level of the user based on the current biological information regarding the user detected by the first sensor, and
that predicts a future arousal level, which is an arousal level a certain period of time later, based on the current arousal level and the current environment information detected by the second sensor; and
a controller that either issues a notification to the user, or controls a first device, based on the future arousal level.
