# US 2024/0200947 A1 · Information processing apparatus, information processing method, information processing program, and information processing system

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0200947 A1
- Document ID: US20240200947A1
- Status: Published application
- Kind: A1
- Application number: 18/551,941
- Filed: 2022-03-29
- Published: 2024-06-20
- Earliest claimed: 2021-03-30
- Assignees: Sony Group Corporation
- Applicants: Sony Group Corporation
- Inventors: Myungjin JUNG; Asae IMAMURA; Hideo NAGASAKA; Yuji KAWABE; Kazumasa HASHIMOTO
- Web page: https://patentgrep.com/patent/US20240200947A1

## CPC

- G01C 21/12: executed aboard the object being navigated; Dead reckoning
- G01C 9/02: Details
- G01C 21/20: Instruments for performing navigational calculations (G01C21/24, G01C21/26 take precedence)
- G01C 22/006: {Pedometers}
- G06F 3/012: {Head tracking input arrangements}
- H04R 1/1016: {Earpieces of the intra-aural type}
- H04R 1/1091: {Details not provided for in groups H04R1/1008 - H04R1/1083}
- G01C 21/206: {specially adapted for indoor navigation}
- H04R 1/1041: {Mechanical or electronic switches, or control elements (switches in general H01H)}
- H04R 25/00: Electric hearing aids
- H04R 2225/021: Behind the ear [BTE] hearing aids
- H04R 2225/39: Aspects relating to automatic logging of sound environment parameters and the performance of the hearing aid during use, e.g. histogram logging, or of user selected programs or settings in the hearing aid, e.g. usage logging
- H04R 2225/41: Detection or adaptation of hearing aid parameters or programs to listening situation, e.g. pub, forest
- H04R 2460/07: Use of position data from wide-area or local-area positioning systems in hearing devices, e.g. program or information selection
- H04R 2460/09: Non-occlusive ear tips, i.e. leaving the ear canal open, for both custom and non-custom tips (H04R2460/11 takes precedence)
- G01C: MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY (measuring liquid level G01F; radio navigation, determining distance or velocity by use of propagation effects, e.g. Doppler effects, propagation time, of radio waves, analogous arrangements using other waves G01S)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- H04R: LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS (producing sounds with frequency not determined by supply frequency G10K)

## Abstract

To provide an information processing apparatus, an information processing method, an information processing program, and an information processing system that control output to a user properly regardless of state. An information processing apparatus includes a user state estimator that estimates a user state; an environment estimator that estimates, on the basis of the user state, an environment state to be provided to a user; and an output controller that controls output on the basis of the environment state.

## Claims

### Claim 1

An information processing apparatus, comprising:
a user state estimator that estimates a user state;
an environment estimator that estimates, on a basis of the user state, an environment state to be provided to a user; and
an output controller that controls output on a basis of the environment state.

### Claim 2 (depends on 1)

The information processing apparatus according to claim 1, further comprising:
a user location estimator that estimates a user location on a basis of a detection value detected by a sensor section that is included in a wearable device that is worn by the user; and
a location attribute estimator that estimates, on a basis of the user location, a location attribute that is an attribute of a location at which the user is, wherein
the user state estimator estimates the user state on a basis of the location attribute.

### Claim 3 (depends on 2)

The information processing apparatus according to claim 2, wherein
the user location estimator estimates the user location using pedestrian dead reckoning (PDR).

### Claim 4 (depends on 2)

The information processing apparatus according to claim 2, wherein
the environment estimator estimates the environment state on the basis of the location attribute.

### Claim 5 (depends on 2)

The information processing apparatus according to claim 2, wherein
the sensor section included in the wearable device includes at least one of an acceleration sensor, a gyroscope, a compass, a biological sensor, or a geomagnetic sensor.

### Claim 6 (depends on 3)

The information processing apparatus according to claim 3, wherein
the user location estimator includes
an angle correction section that calculates a correction value for an azimuth corresponding to the user on the basis of the detection value detected by the sensor section included in the wearable device worn by the user, and
an angle estimator that estimates the azimuth corresponding to the user on the basis of the detection value detected by the sensor section included in the wearable device worn by the user, and on a basis of the correction value, and
the user location estimator estimates the user location using the azimuth.

### Claim 7 (depends on 3)

The information processing apparatus according to claim 3, wherein
the user location estimator estimates a route of movement of the user location, and
on a basis of the route of the movement, the location attribute estimator estimates the location attribute after the movement.

### Claim 8 (depends on 7)

The information processing apparatus according to claim 7, wherein
the location attribute estimator holds a plurality of the routes of the movement, and performs matching by checking the estimated route of the movement against the plurality of the routes of the movement to estimate the location attribute after the movement.

### Claim 9 (depends on 8)

The information processing apparatus according to claim 8, wherein
when the location attribute estimator has failed to perform matching a specified number of times, the location attribute estimator outputs an alert.

### Claim 10 (depends on 8)

The information processing apparatus according to claim 8, wherein
the location attribute estimator performs the matching using dynamic time warping (DTW).

### Claim 11 (depends on 1)

The information processing apparatus according to claim 1, wherein
the location attribute estimator estimates the location attribute by determining a period of time for which the user stays at a location at which the user is.

### Claim 12 (depends on 1)

The information processing apparatus according to claim 1, further comprising
a context acquisition section that acquires a context of the user, wherein
the user state estimator estimates the user state on a basis of the acquired context.

### Claim 13 (depends on 12)

The information processing apparatus according to claim 12, wherein
the context includes at least one of location information regarding a location of the user or terminal information regarding the information processing apparatus.

### Claim 14 (depends on 1)

The information processing apparatus according to claim 1, wherein
the user state estimator estimates the user state on a basis of the detection value detected by the sensor section included in the wearable device and/or on a basis of the location attribute.

### Claim 15 (depends on 1)

The information processing apparatus according to claim 1, wherein
the user state includes a plurality of activity states of the user.

### Claim 16 (depends on 1)

The information processing apparatus according to claim 1, wherein
the output controller includes
a content controller that plays back content selected on the basis of the environment state and/or
a notice controller that controls, on the basis of the environment state, the number of notices provided to the user, and
the content controller successively plays back related pieces of content for respective environment states that are identical to each other but provided for different periods of time.

### Claim 17 (depends on 6)

The information processing apparatus according to claim 6, wherein
the sensor section included in the wearable device includes an acceleration sensor, and
the angle correction section
calculates an inclination of the user in a pitch direction and an inclination of the user in a roll direction, using gravitational acceleration that corresponds to the detection value detected by the acceleration sensor and occurs when the user faces the roll direction,
calculates an inclination of the user in a yaw direction using gravitational acceleration that corresponds to the detection value detected by the acceleration sensor and occurs when the user faces the pitch direction, and using the inclination in the pitch direction and the inclination in the roll direction, and
determines, to be the correction values, the inclination in the pitch direction, the inclination in the roll direction, and the inclination in the yaw direction.

### Claim 18 (depends on 5)

The information processing apparatus according to claim 5, further comprising:
a database generator that associates a registration-use detection value detected by the sensor section with an environment state to be provided to the user when the registration-use detection value is detected, and registers the associated registration-use detection value and environment state; and
a matching section that checks a new detection value detected by the sensor section against the registered registration-use detection value to perform matching, and determines whether a difference between the new detection value and the registration-use detection value is less than or equal to a matching threshold, wherein
when the difference is determined to be less than or equal to the matching threshold, the output controller controls output on a basis of the environment state registered in association with the registration-use detection value.

### Claim 19 (depends on 18)

The information processing apparatus according to claim 18, wherein
when the user is at a stop for a first period of time, the matching section checks the new detection value with the registration-use detection value to perform matching, and
when a period of time for which the user is at a stop from the user stopping to the user starting moving is longer than a second period of time, the database generator associates the new detection value detected for the period of time from the user stopping to the user starting moving with an environment state to be provided to the user when the new detection value is detected, and newly registers the associated new detection value and environment state.

### Claim 20 (depends on 18)

The information processing apparatus according to claim 18, wherein
the database generator registers, as the registration-use detection value, an average of a plurality of the detection values detected by the sensor section for a specified period of time.

### Claim 21

An information processing apparatus, comprising:
a database generator that associates a registration-use detection value detected by a sensor section included in a wearable device worn by a user with an environment state to be provided to the user when the registration-use detection value is detected, and registers the associated registration-use detection value and environment state;
a matching section that checks a new detection value detected by the sensor section against the registered registration-use detection value to perform matching, and determines whether a difference between the new detection value and the registration-use detection value is less than or equal to a matching threshold; and
an output controller that controls output when the difference is determined to be less than or equal to the matching threshold, the output being controlled on a basis of the environment state registered in association with the registration-use detection value.

### Claim 22

An information processing method, comprising:
estimating a user state;
estimating, on a basis of the user state, an environment state to be provided to a user; and
controlling output on a basis of the environment state.

### Claim 23

An information processing program that causes a processor of an information processing apparatus to operate as
a user state estimator that estimates a user state,
an environment estimator that estimates, on a basis of the user state, an environment state to be provided to a user, and
an output controller that controls output on a basis of the environment state.

### Claim 24

An information processing system, comprising:
a wearable device; and
an information processing apparatus that includes
a user state estimator that estimates a user state of a user who is wearing the wearable device,
an environment estimator that estimates, on a basis of the user state, an environment state to be provided to the user, and
an output controller that controls output on a basis of the environment state.
