# US 2021/0241538 A1 · Support image display apparatus, support image display method, and computer readable medium

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0241538 A1
- Document ID: US20210241538A1
- Status: Published application
- Kind: A1
- Application number: 16/098,719
- Filed: 2016-06-20
- Published: 2021-08-05
- Earliest claimed: 2016-06-20
- Assignees: Mitsubishi Electric Corporation
- Applicants: Mitsubishi Electric Corporation
- Inventors: Naoyuki TSUSHIMA
- Web page: https://patentgrep.com/patent/US20210241538A1

## CPC

- B60R 1/00: Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
- G06T 19/20: Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts
- B60K 35/10: Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor
- B60K 35/22: Display screens
- B60K 35/23: Head-up displays [HUD] (optical aspects of head-up displays G02B27/01)
- B60K 35/28: characterised by the type of the output information, e.g. video entertainment or vehicle dynamics information; characterised by the purpose of the output information, e.g. for attracting the attention of the driver
- B60K 35/50: Instruments characterised by their means of attachment to or integration in the vehicle (B60K35/231 takes precedence)
- B60K 35/81: for controlling displays
- G01C 21/36: Input/output arrangements for on-board computers
- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- G08G 1/16: Anti-collision systems (road vehicle drive control systems for predicting or avoiding probable or impending collision otherwise than by control of a particular sub-unit B60W30/08)
- G08G 1/165: {for passive traffic, e.g. including static obstacles, trees}
- G09G 5/00: Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators (image data processing or generation, in general G06T)
- G09G 5/38: with means for controlling the display position
- H04N 7/18: Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
- B60R 2300/305: merging camera image with lines or icons
- B60R 2300/308: by overlaying the real scene, e.g. through a head-up display on the windscreen
- G06T 2219/2004: Aligning objects, relative positioning of parts
- B60R: VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- B60K: ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- G01C: MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY (measuring liquid level G01F; radio navigation, determining distance or velocity by use of propagation effects, e.g. Doppler effects, propagation time, of radio waves, analogous arrangements using other waves G01S)
- G08G: TRAFFIC CONTROL SYSTEMS (guiding railway traffic, ensuring the safety of railway traffic B61L; arrangement of road signs or traffic signals E01F9/00; radar or analogous systems, sonar systems, lidar systems specially adapted for traffic control G01S13/91, G01S15/88, G01S17/88; {radar or analogous systems, sonar systems, lidar systems specially adapted for anti-collision purposes G01S13/93, G01S15/93, G01S17/93})
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A support image display apparatus displays a support image that points out an object included in a landscape observed from a viewpoint position of a moving body so as to be superimposed on the landscape. An image generation section generates a support image that points out a reference position of the object. A display control section changes, when a complexity of the landscape in a surrounding of the object is high, a display position of the support image generated by the image generation section to a region with a low complexity, and thereafter displays the support image so as to be superimposed on the landscape.

## Claims

### Claim at position 1

1-7. (canceled)

### Claim 8

A support image display apparatus that displays a support image to point out an object included in a landscape observed from a viewpoint position of a moving body so as to be superimposed on the landscape, the support image display apparatus comprising:
processing circuitry to:
generate the support image that points out a reference position of the object;
determine whether a complexity of a landscape of a region serving as a background of the generated support image is higher than a threshold; and
when the complexity of the landscape of the region serving as the background is determined to be higher than the threshold, change a position of the generated support image such that a position pointed out by the support image becomes a position that can be visually recognized by the moving body and the position is in a region with a low complexity, out of regions in a surrounding of the reference position, and thereafter display the support image.

### Claim 9 (depends on 8)

The support image display apparatus according to claim 8, wherein the processing circuitry calculates a two-dimensional spatial frequency of the landscape of the region serving as the background to specify the complexity.

### Claim 10 (depends on 9)

The support image display apparatus according to claim 9, wherein the processing circuitry calculates a two-dimensional spatial frequency for each of a plurality of regions obtained by dividing the surrounding of the reference position, and specifies the complexity for each of the regions, and
when the complexity of the region serving as the background is higher than the threshold, changes the position of the support image to the region with the low complexity, and thereafter displays the support image.

### Claim 11

A support image display method that displays a support image to point out an object included in a landscape observed from a viewpoint position of a moving body so as to be superimposed on the landscape, the support image display method comprising:
generating the support image that points out a reference position of the object;
determining whether a complexity of a landscape of a region serving as a background of the support image is higher than a threshold; and
when the complexity of the landscape of the region serving as the background is higher than the threshold, changing a position of the support image such that a position pointed out by the support image becomes a position that can be visually recognized by the moving body and the position is in a region with a low complexity, out of regions in a surrounding of the reference position, and thereafter displaying the support image.

### Claim 12

A non-transitory computer readable medium storing a support image display program that displays a support image to point out an object included in a landscape observed from a viewpoint position of a moving body so as to be superimposed on the landscape, the support image display program causing a computer to execute:
an image generation process to generate the support image that points out a reference position of the object;
a complexity determination process to determine whether a complexity of a landscape of a region serving as a background of the support image generated by the image generation process is higher than a threshold; and
a display control process to, when the complexity of the landscape of the region serving as the background is determined to be higher than the threshold by the complexity determination process, change a position of the support image generated by the image generation process such that a position pointed out by the support image becomes a position that can be visually recognized by the moving body and the position is in a region with a low complexity, out of regions in a surrounding of the reference position, and thereafter display the support image.
