# US 12,183,092 B2 · Information processing apparatus, control method, and computer-readable medium

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,183,092 B2
- Document ID: US12183092B2
- Status: Granted
- Kind: B2
- Application number: 18/123,716
- Filed: 2023-03-20
- Published: 2023-09-28
- Granted: 2024-12-31
- Earliest claimed: 2022-03-24
- Assignees: Panasonic Automotive Systems Co., Ltd.
- Applicants: Panasonic Intellectual Property Management Co., Ltd.
- Inventors: Satoshi Fujikawa; Kazuhiko Yamauchi
- Web page: https://patentgrep.com/patent/US12183092B2

## CPC

- G06V 20/59: inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
- G01C 21/3415: {Dynamic re-routing, e.g. recalculating the route when the user deviates from calculated route or after detecting real-time traffic data or accidents}
- G01C 21/3484: {Personalized, e.g. from learned user behaviour or user-defined profiles}
- G01C 21/3605: {Destination input or retrieval}
- G01C 21/3629: {Guidance using speech or audio output, e.g. text-to-speech (text to speech systems per se G10L13/00)}
- G05D 1/021: {specially adapted to land vehicles}
- G05D 1/43: Control of position or course in two dimensions [2D]
- G06T 7/20: Analysis of motion (motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51)
- G06V 40/20: Movements or behaviour, e.g. gesture recognition (recognition of facial expressions G06V40/16)
- B60R 16/0232: {for measuring vehicle parameters and indicating critical, abnormal or dangerous conditions}
- B60R 21/01512: {Passenger detection systems}
- B60R 21/01556: {Child-seat detection systems}
- B60R 2021/006: {Type of passenger}
- G05D 2109/10: Land vehicles
- G06T 2207/30268: Vehicle interior
- G07C 5/0891: {Video recorder in combination with video camera}
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G01C: MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY (measuring liquid level G01F; radio navigation, determining distance or velocity by use of propagation effects, e.g. Doppler effects, propagation time, of radio waves, analogous arrangements using other waves G01S)
- G05D: SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- B60R: VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- G07C: TIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE

## Abstract

According to the present disclosure, an information processing apparatus communicates with a sensor device that transmits a video of a passenger and environmental information at least when a vehicle is moving. The information processing apparatus includes a memory, and a hardware processor coupled to the memory. The hardware processor being configured to: receive the video and the environmental information from the sensor device; output the received video; analyze information regarding a behavior sign of the passenger based on at least one of the received video and a change in the environmental information accompanying movement of the vehicle; and perform output control of changing an output way and outputting message information, based on an analysis result of the behavior sign.

## Claims

### Claim 1

An information processing apparatus that communicates with a sensor device that transmits a video of a passenger and environmental information at least when a vehicle is moving, the information processing apparatus comprising:
a memory; and
a hardware processor coupled to the memory,
the hardware processor being configured to:
receive the video and the environmental information from the sensor device;
output the received video;
analyze information regarding a behavior sign of the passenger based on at least one of the received video and a change in the environmental information accompanying movement of the vehicle;
perform output control of changing an output way and outputting message information, based on an analysis result of the behavior sign;
present a drive plan to a user; and
perform navigation for guiding parking based on an analysis result of the behavior sign.

### Claim 2

An information processing apparatus that communicates with a sensor device that transmits a video of a passenger and environmental information at least when a vehicle is moving, the information processing apparatus comprising:
a memory; and
a hardware processor coupled to the memory, the hardware processor being configured to:
receive the video and the environmental information from the sensor device;
output the received video;
analyze information regarding a behavior sign of the passenger based on at least one of the received video and a change in the environmental information accompanying movement of the vehicle;
perform output control of changing an output way and outputting message information, based on an analysis result of the behavior sign;
record childcare history information indicating a behavior history of the passenger before getting on the vehicle; and
estimate behavior of the passenger while riding based on the childcare history information.

### Claim 3 (depends on 2)

The information processing apparatus according to claim 2, wherein the hardware processor is configured to:
further record information regarding age in months and/or age in weeks of the passenger; and
estimate behavior of the passenger while riding based on the childcare history information and the information regarding age in months and/or age in weeks.

### Claim 4 (depends on 2)

The information processing apparatus according to claim 2, wherein the hardware processor is further configured to search for a route based on at least a destination, a scheduled riding time, and an estimation result of behavior of the passenger while riding.

### Claim 5

An information processing apparatus that communicates with a sensor device that transmits a video of a passenger and environmental information at least when a vehicle is moving, the information processing apparatus comprising:
a memory; and
a hardware processor coupled to the memory, the hardware processor being configured to:
receive the video and the environmental information from the sensor device;
output the received video;
analyze information regarding a behavior sign of the passenger based on at least one of the received video and a change in the environmental information accompanying movement of the vehicle;
perform output control of changing an output way and outputting message information, based on an analysis result of the behavior sign;
control movement determination of determining whether or not the vehicle is moving, and switching of a plurality of modes related to output control;
allow an in-vehicle user to perform interactive processing with a device of an out-of-vehicle user; and
notify the device of the out-of-vehicle user of an analysis result of the behavior sign and presence or absence of the movement of the vehicle.

### Claim 6 (depends on 5)

The information processing apparatus according to claim 5, wherein
the interactive processing includes at least a normal mode and an emergency mode,
in the normal mode, the interactive processing is started when receiving an operation of permitting an incoming call by the in-vehicle user,
in the emergency mode, the interactive processing is started even when the in-vehicle user performs no operation of permitting an incoming call, and
the hardware processor is configured to permit the emergency mode based on the analysis result of the behavior sign.