# US 12,603,024 B2 · Display control device

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,603,024 B2
- Document ID: US12603024B2
- Status: Granted
- Kind: B2
- Application number: 18/684,393
- Filed: 2022-06-09
- Published: 2024-10-31
- Granted: 2026-04-14
- Earliest claimed: 2021-08-25
- Assignees: Ntt Docomo, Inc.
- Applicants: Ntt Docomo, Inc.
- Inventors: Kei Ishiguro; Tomohito Yamasaki; Mikio Iwamura; Masayuki Yokoo; Fuminori Shinsei
- Web page: https://patentgrep.com/patent/US12603024B2

## CPC

- G09G 3/003: {to produce spatial visual effects}
- G06F 3/04842: Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence)
- G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80)
- G06T 19/00: Manipulating three-dimensional [3D] models or images for computer graphics
- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- G06T 19/20: Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

A display control device includes a mode detecting unit configured to detect a mode corresponding to a level of understanding of a spatial structure of a real space displayed on a display unit and a control unit configured to control a display mode of a virtual object on the display unit according to the mode detected by the mode detecting unit. The control unit changes the display mode of the virtual object on the display unit from a first display mode corresponding to a first mode to a second display mode corresponding to a second mode via one or more intermediate display modes between the first display mode and the second display mode when the mode detected by the mode detecting unit changes from the first mode corresponding to a first level of understanding to the second mode corresponding to a second level of understanding.

## Claims

### Claim 1

A display control device that performs display control of a display unit on which a virtual object along with a real space is displayed, the display control device comprising:
processing circuitry configured to
detect a mode corresponding to a level of understanding of a spatial structure of the real space displayed on the display unit;
control a display mode of the virtual object on the display unit according to the detected mode; and
change the display mode of the virtual object on the display unit from a first display mode corresponding to a first mode to a second display mode corresponding to a second mode via one or more intermediate display modes between the first display mode and the second display mode when the detected mode changes from the first mode corresponding to a first level of understanding to the second mode corresponding to a second level of understanding,
wherein
the processing circuitry is further configured to gradually change the display mode of the virtual object from the first display mode to the second display mode over a predetermined transition period,
the second display mode includes a display mode in which a part of the virtual object hidden by the real object is displayed transparently,
the one or more intermediate display modes include a display mode in which the part of the virtual object hidden in the real object is displayed semi-transparently, and
the change from the first display mode to the second display mode indicates a transition of the virtual object's appearance relative to the real object from being displayed in front of the real object to being occluded by the real object.

### Claim 2 (depends on 1)

The display control device according to claim 1, wherein the predetermined transition period elapses from a time point at which the mode detected by the processing circuitry has changed from the first mode to the second mode.

### Claim 3 (depends on 1)

The display control device according to claim 1, wherein the first level of understanding is a level of understanding corresponding to a state in which a positional relationship between a real object included in the real space and the virtual object which are displayed on the display unit is not able to be identified with a predetermined precision or higher,
wherein the second level of understanding is a level of understanding corresponding to a state in which a positional relationship between the real object included in the real space and the virtual object which are displayed on the display unit is able to be identified with the predetermined precision or higher, and
wherein the first display mode includes a display mode in which the virtual object is displayed in front of the real object regardless of an original positional relationship between the virtual object and the real object.

### Claim 4 (depends on 3)

The display control device according to claim 3, wherein the processing circuitry is further configured to
acquire location information indicating a location of the real space displayed on the display unit,
determine whether space data on the spatial structure of the location indicated by the acquired location information is available;
detect the first mode when the space data is not available; and
detect the second mode when the space data is available; and
identify the part of the virtual object hidden in the real object based on the space data when the virtual object is displayed in the second display mode.

### Claim 5 (depends on 1)

The display control device according to claim 1, wherein the first display mode includes a display mode in which the virtual object is displayed in a first size,
wherein the second display mode includes a display mode in which the virtual object is displayed in a second size different from the first size, and
wherein the one or more intermediate display modes include a display mode in which the virtual object is displayed in a size between the first size and the second size.

### Claim 6 (depends on 5)

The display control device according to claim 5, wherein the second size is larger than the first size.

### Claim 7 (depends on 1)

The display control device according to claim 1, wherein the first display mode includes a display mode in which the virtual object is displayed in a first color tone,
wherein the second display mode includes a display mode in which the virtual object is displayed in a second color tone different from the first color tone, and
wherein the one or more intermediate display modes include a display mode in which the virtual object is displayed in a third color tone between the first color tone and the second color tone.

### Claim 8 (depends on 1)

The display control device according to claim 1, wherein the first display mode includes a display mode in which the virtual object is displayed in a first shape,
wherein the second display mode includes a display mode in which the virtual object is displayed in a second shape different from the first shape, and
wherein the one or more intermediate display modes include a display mode in which the virtual object is displayed in a third shape between the first shape and the second shape.

### Claim 9

A method implemented by processing circuitry of a display control device that performs display control of a display unit on which a virtual object along with a real space is displayed, the method comprising:
detecting a mode corresponding to a level of understanding of a spatial structure of the real space displayed on the display unit;
controlling a display mode of the virtual object on the display unit according to the detected mode,
changing the display mode of the virtual object on the display unit from a first display mode corresponding to a first mode to a second display mode corresponding to a second mode via one or more intermediate display modes between the first display mode and the second display mode when the detected mode changes from the first mode corresponding to a first level of understanding to the second mode corresponding to a second level of understanding,
wherein
the method further includes gradually changing the display mode of the virtual object from the first display mode to the second display mode over a predetermined transition period,
the second display mode includes a display mode in which a part of the virtual object hidden by the real object is displayed transparently,
the one or more intermediate display modes include a display mode in which the part of the virtual object hidden in the real object is displayed semi-transparently, and
the change from the first display mode to the second display mode indicates a transition of the virtual object's appearance relative to the real object from being displayed in front of the real object to being occluded by the real object.