# US 10,766,405 B2 · Semiconductor device and message image output method

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,766,405 B2
- Document ID: US10766405B2
- Status: Granted
- Kind: B2
- Application number: 16/435,067
- Filed: 2019-06-07
- Published: 2019-12-26
- Granted: 2020-09-08
- Earliest claimed: 2018-06-21
- Assignees: Renesas Electronics Corporation
- Applicants: Renesas Electronics Corporation
- Inventors: Koji Yasuda; Hirofumi Kawaguchi; Akihide Takahashi
- Web page: https://patentgrep.com/patent/US10766405B2

## CPC

- G03B 21/142: {Adjusting of projection optics}
- B25J 19/06: Safety devices
- B60Q 1/346: {with automatic actuation}
- B60Q 1/38: using immovably-mounted light sources, e.g. fixed flashing lamps
- B60Q 1/50: for indicating other intentions or conditions, e.g. request for waiting or overtaking
- G01C 21/3697: {Output of additional, non-guidance related information, e.g. low fuel level (G01C21/3679 takes precedence)}
- G02B 27/01: Head-up displays
- G09G 5/38: with means for controlling the display position
- B60Q 2400/20: Multi-color single source or LED matrix, e.g. yellow blinker and red brake lamp generated by single lamp
- B60Q 2400/50: Projected symbol or information, e.g. onto the road or car body
- B62J 6/057: Automatic activation, e.g. by sensors
- G02B 2027/0138: {comprising image capture systems, e.g. camera}
- G02B 2027/014: {comprising information/image processing systems}
- G02B 2027/0141: {characterised by the informative content of the display}
- G09G 2380/10: Automotive applications
- G03B: APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR (optical parts of such apparatus G02B; photosensitive materials or processes for photographic purposes G03C; apparatus for processing exposed photographic materials G03D)
- B25J: MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES ({manipulators specially adapted for use in surgery A61B34/70; manipulators used in cleaning hollow articles B08B9/04}; manipulators associated with rolling mills B21B39/20; manipulators associated with forging machines B21J13/10; {manipulators associated with picking-up and placing mechanisms B23P19/007}; means for holding wheels or parts thereof B60B30/00; {vehicles with ground-engaging propulsion means, e.g. walking members B62D57/02, B62D57/032; devices for picking-up and depositing articles or materials between conveyors B65G47/90, B65G47/91; manipulators with gripping or holding means for transferring packages B65H67/065}; cranes B66C; {manipulators used in the protection or supervision of pipe-line installations F17D5/00; walking equipment adapted for nuclear steam-generators F22B37/006}; manipulators specially adapted for, or associated with, nuclear reactors G21C; {apparatus used for handling wafers during manufacture or treatment of semiconductor H10P72/50})
- B60Q: ARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
- G01C: MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY (measuring liquid level G01F; radio navigation, determining distance or velocity by use of propagation effects, e.g. Doppler effects, propagation time, of radio waves, analogous arrangements using other waves G01S)
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)
- B62J: CYCLE SADDLES OR SEATS; AUXILIARY DEVICES OR ACCESSORIES SPECIALLY ADAPTED TO CYCLES AND NOT OTHERWISE PROVIDED FOR, e.g. ARTICLE CARRIERS OR CYCLE PROTECTORS

## Abstract

To provide a semiconductor device which suppresses a message image projected by a mobile from varying from a desired position. A semiconductor device has a first area decision part which decides a first area onto which a message image is projected, based on movement information of a mobile. The semiconductor device has a delay period calculation part which calculates a delay period being a period from a first time for projecting the message image onto the first area to a second time when the message image is projectable. Also, the semiconductor device has a second area decision part which adjusts the first area, based on the delay period to decide a second area. Further, the semiconductor device has an image signal conversion part which converts a message image signal according to the second area.

## Claims

### Claim 1

A semiconductor device which outputs a message image signal being a signal of a message image to be projected onto a periphery of a mobile, the semiconductor device comprising:
a first area decision part which decides based on movement information of the mobile, a first area being an area onto which the message image is projected at a first time being a schedule time when the message image is to be projected;
a delay period calculation part which calculates a delay period being a period from the first time when the message image is projected onto the first area to a second time when the message image is projectable;
a second area decision part which adjusts the first area on the basis of the movement information and the delay period to decide a second area; and
an image signal conversion part which converts the message image signal according to the second area.

### Claim 2 (depends on 1)

The semiconductor device according to claim 1, further comprising a message image output part which outputs the message image signal converted by the image signal conversion part.

### Claim 3 (depends on 1)

The semiconductor device according to claim 1, wherein the first area decision part decides the first area on the basis of the movement information including a moving speed and a steering angle of the mobile.

### Claim 4 (depends on 1)

The semiconductor device according to claim 1, wherein the first area decision part decides the first area on the basis of the movement information including an image signal of an image obtained by imaging the periphery of the mobile.

### Claim 5 (depends on 1)

The semiconductor device according to claim 1, further including an output time decision part which decides a signal output time being a time when a message image signal is output,
wherein the message image output part outputs the message image signal according to the signal output time.

### Claim 6 (depends on 4)

The semiconductor device according to claim 4, wherein the delay period calculation part sets the second time on the basis of the signal output time.

### Claim 7 (depends on 5)

The semiconductor device according to claim 5, wherein the delay period calculation part adds a preset additive period to the signal output time to decide the second time.

### Claim 8 (depends on 1)

The semiconductor device according to claim 1, wherein the first area decision part decides the first area in a range exceeding a projectable area being an area capable of projecting the message image thereon.

### Claim 9 (depends on 1)

The semiconductor device according to claim 1, further including an area determination part,
wherein when the second area is not included in the projectable area, the area determination part stops processing of outputting the message image signal.

### Claim 10 (depends on 1)

The semiconductor device according to claim 1, wherein the image signal conversion part has a conversion function of deciding a degree of distortion of an image according to the projection area.

### Claim 11 (depends on 9)

The semiconductor device according to claim 9, wherein the image signal conversion part has a conversion function of trapezoid-converting an image.

### Claim 12 (depends on 1)

The semiconductor device according to claim 1, further including:
a reference image signal output part which outputs a reference image signal being a signal of a reference image corresponding to the projection area being the area onto which the message image is projected;
a test image signal acquisition part which acquires a test image signal being a signal of a test signal obtained by imaging the projection area onto which the reference image is projected;
a comparison part which compares the reference image signal with the test image signal; and
an image adjustment part which adjusts the message image signal on the basis of the result of comparison therebetween,
wherein the message image output part outputs the message image signal converted by the image signal conversion part and adjusted by the image adjustment part.

### Claim 13 (depends on 11)

The semiconductor device according to claim 11, wherein the reference image signal output part outputs a reference image signal converted by the image signal conversion part.

### Claim 14 (depends on 11)

The semiconductor device according to claim 11, wherein the image adjustment part adjusts a pixel value included in the message image signal.

### Claim 15 (depends on 11)

The semiconductor device according to claim 11, wherein the reference image signal output part outputs the reference image signal in which brightness values of red, green and blue are equal to each other.

### Claim 16 (depends on 11)

The semiconductor device according to claim 11, further including an adjustment signal acquisition part which acquires an adjustment signal corresponding to the reference image projected by the mobile from a target positioned around the mobile,
wherein the image adjustment part adjusts a message image on the basis of the adjustment signal acquired from the target.

### Claim 17 (depends on 15)

The semiconductor device according to claim 15, further including a permission determination part which determines whether the target allows projection of the reference image.

### Claim 18 (depends on 15)

The semiconductor device according to claim 15, further including a position estimation part,
wherein the position estimation part calculates an estimation position being a relative position of the mobile and the target at a schedule time when the message image is to be projected, on the basis of the movement information of the mobile and movement information of the target, and
wherein the first area decision part decides the first area on the basis of the estimation position.

### Claim 19 (depends on 11)

The semiconductor device according to claim 11, further including an adjustment signal output part,
wherein the test image signal acquisition part acquires a sample image signal being a signal of an image obtained by capturing a sample image projected by a projecting device moved around the mobile,
wherein the comparison part compares the reference image signal with the sample image signal, and
wherein the adjustment signal output part outputs an adjustment signal for adjusting the sample image signal on the basis of a result of comparison between the reference image signal and the sample image signal.

### Claim 20

A message image signal output method of outputting a message image signal being a signal of a message image to be projected onto a periphery of a mobile, the method comprising:
deciding based on movement information of the mobile, a first time being a schedule time when the message image is to be projected, and a first area being an area onto which the message image is projected, respectively;
calculating a delay period being a period from the first time when the message image is projected onto the first area to a second time when the message image is projectable;
adjusting the first area on the basis of the movement information and the delay period to decide a second area; and
converting the message image signal according to the second area.
