# US 10,308,164 B2 · Mobile object and storage medium

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,308,164 B2
- Document ID: US10308164B2
- Status: Granted
- Kind: B2
- Application number: 14/023,755
- Filed: 2013-09-11
- Published: 2014-03-27
- Granted: 2019-06-04
- Earliest claimed: 2012-09-21
- Assignees: Sony Corporation
- Applicants: Sony Corporation
- Inventors: Yoichiro Sako; Hiroshi Okada; Kazuhiro Watanabe; Kazuyuki Sakoda; Hirofumi Yuchi; Kohei Asada
- Web page: https://patentgrep.com/patent/US10308164B2

## CPC

- B60Q 1/0023: {the element being a sensor, e.g. distance sensor, camera}
- B60Q 1/0017: {Devices integrating an element dedicated to another function}
- B60Q 1/04: the devices being headlights
- B60Q 5/008: {for signaling silent vehicles, e.g. for warning that a hybrid or electric vehicle is approaching}
- F21S 41/645: {by electro-optic means, e.g. liquid crystal or electrochromic devices}
- F21S 41/675: by moving reflectors
- G03B 21/006: {using LCD's}
- G03B 21/2066: {Reflectors in illumination beam (in projection beam G03B21/28)}
- G08G 1/166: {for active traffic, e.g. moving vehicles, pedestrians, bikes}
- H04N 7/002: {Special television systems not provided for by H04N7/007 - H04N7/18 (still pictures via a television channel H04N1/00098)}
- B60Q: ARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
- F21S: NON-PORTABLE LIGHTING DEVICES; SYSTEMS THEREOF; VEHICLE LIGHTING DEVICES SPECIALLY ADAPTED FOR VEHICLE EXTERIORS
- G03B: APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR (optical parts of such apparatus G02B; photosensitive materials or processes for photographic purposes G03C; apparatus for processing exposed photographic materials G03D)
- G08G: TRAFFIC CONTROL SYSTEMS (guiding railway traffic, ensuring the safety of railway traffic B61L; arrangement of road signs or traffic signals E01F9/00; radar or analogous systems, sonar systems, lidar systems specially adapted for traffic control G01S13/91, G01S15/88, G01S17/88; {radar or analogous systems, sonar systems, lidar systems specially adapted for anti-collision purposes G01S13/93, G01S15/93, G01S17/93})
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

There is provided a mobile object including an imaging unit configured to capture a perimeter of the mobile object, a speaker configured to be capable of controlling directivity, a determination unit configured to determine whether the mobile object is in a driving mode, and a speaker control unit configured to control the speaker in the driving mode in a manner that predetermined audio is output toward a warning target that is recognized based on a captured image captured by the imaging unit, and to control the speaker in a non-driving mode in a manner that the predetermined audio is output in a non-directional way.

## Claims

### Claim 1

A mobile object, comprising:
an image sensor configured to capture an image of a perimeter of the mobile object;
a speaker;
a headlight configured to project a video; and
a central processing unit (CPU) configured to:
determine the mobile object is in one of a non-driving mode or a driving mode;
control the headlight to project the video based on the determination that the mobile object is in the non-driving mode;
detect a viewer position based on the captured image of the perimeter of the mobile object and the determination that the mobile object is in the non-driving mode;
control, based on the detected viewer position, the headlight to change a direction of the projection of the video;
switch the speaker to an omni-directivity mode from a directivity mode based on the determination that the mobile object is in the non-driving mode;
recognize a warning target based on the captured image and the determination that the mobile object is in the driving mode; and
switch the speaker to the directivity mode from the omni-directivity mode based on the determination that the mobile object is in the driving mode, wherein
in the directivity mode, the speaker is configured to output audio towards the recognized warning target, and
in the omni-directivity mode, the speaker is further configured to omni-directionally output the audio.

### Claim 2 (depends on 1)

The mobile object according to claim 1, wherein the CPU is further configured to:
reproduce input content data; and
control the reproduction of the input content data in the non-driving mode such that the headlight is further configured to project the video and the speaker is further configured to omni-directionally output the audio.

### Claim 3 (depends on 2)

The mobile object according to claim 2, wherein the CPU is further configured to control, in the non-driving mode, a shape of the projected video based on the detected viewer position.

### Claim 4 (depends on 3)

The mobile object according to claim 3, wherein the headlight includes a physical mechanism configured to change the direction of the projection of the video.

### Claim 5 (depends on 2)

The mobile object according to claim 2, wherein the CPU is further configured to control color information of the projected video, based on the captured image.

### Claim 6 (depends on 2)

The mobile object according to claim 2, wherein the headlight is further configured to:
emit light in the driving mode; and
project the video in the non-driving mode.

### Claim 7 (depends on 2)

The mobile object according to claim 2, wherein the headlight is further configured to:
project white light in the driving mode; and
project a content video in the non-driving mode.

### Claim 8 (depends on 1)

The mobile object according to claim 1, wherein the CPU is further configured to recognize, based on a distance between a person detected from the captured image and the mobile object and based on a relative speed of the person with respect to the mobile object, the person as the warning target in the driving mode.

### Claim 9 (depends on 1)

The mobile object according to claim 1, wherein the CPU is further configured to control a position for localization of a sound image of the audio output from the speaker in the non-driving mode, based on the detected viewer position.

### Claim 10 (depends on 1)

The mobile object according to claim 1, wherein the CPU is further configured to determine the mobile object is in one of the driving mode or the non-driving mode, based on at least one of an odometer value, a vibration measurement value, position information, or a driving sound measurement value.

### Claim 11 (depends on 1)

The mobile object according to claim 1, wherein the CPU is further configured to control, in the driving mode, the speaker to output a warning sound toward the recognized warning target.

### Claim 12

A non-transitory computer-readable medium having stored thereon computer-executable instructions that, when executed by a processor, cause the processor to execute operations, the operations comprising:
controlling an image sensor of a mobile object for capturing an image of a perimeter of the mobile object;
determining the mobile object is in one of a non-driving mode or a driving mode;
controlling a headlight of the mobile object for projecting a video, based on the determination that the mobile object is in the non-driving mode;
detecting a viewer position based on the captured image of the perimeter of the mobile object and the determination that the mobile object is in the non-driving mode;
controlling, based on the detected viewer position, the headlight to change a direction of the projection of the video;
switching a speaker of the mobile object to an omni-directivity mode from a directivity mode based on the determination that the mobile object is in the non-driving mode;
recognizing a warning target based on the captured image and the determination that the mobile object is in the driving mode; and
switching the speaker to the directivity mode from the omni-directivity mode based on the determination that the mobile object is in the driving mode, wherein
in the directivity mode, the speaker is configured to output audio towards the recognized warning target, and
in the omni-directivity mode, the speaker is further configured to omni-directionally output the audio.