# US 11,909,945 B2 · Display control device, display control method, and program > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 11,909,945 B2 - Document ID: US11909945B2 - Status: Granted - Kind: B2 - Application number: 17/558,537 - Filed: 2021-12-21 - Published: 2022-04-14 - Granted: 2024-02-20 - Earliest claimed: 2019-06-28 - Assignees: FUJIFILM Corporation - Applicants: Fujifilm Corporation - Inventors: Fuminori Irie; Takashi Aoki; Kazunori Tamura; Masahiko Miyata - Web page: https://patentgrep.com/patent/US11909945B2 ## CPC - G09G 3/001: {using specific devices not provided for in groups G09G3/02 - G09G3/36, e.g. using an intermediate record carrier such as a film slide; Projection systems; Display of non-alphanumerical information, solely or in combination with alphanumerical information, e.g. digital display on projected diapositive as background (slide projectors per se G03B23/00 = 42 HP)} - H04N 13/282: for generating image signals corresponding to three or more geometrical viewpoints, e.g. multi-view systems - G02B 27/017: {Head mounted} - G06T 19/00: Manipulating three-dimensional [3D] models or images for computer graphics - G09G 5/00: Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators (image data processing or generation, in general G06T) - G09G 5/36: characterised by the display of a graphic pattern, e.g. using an all-points-addressable [APA] memory - G09G 5/377: for mixing or overlaying two or more graphic patterns (G09G5/02, G09G5/397 take precedence) - H04N 5/265: Mixing - H04N 7/18: Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast - H04N 13/111: Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation - H04N 13/243: using three or more two-dimensional [2D] image sensors - H04N 13/279: the virtual viewpoint locations being selected by the viewers or determined by tracking - G02B 2027/0138: {comprising image capture systems, e.g. camera} - G02B 2027/014: {comprising information/image processing systems} - G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00) - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL ## Abstract A display control device includes a first acquisition unit that acquires first viewpoint position information, and a first control unit that performs a control of displaying a first viewpoint video selected from among a plurality of viewpoint videos generated based on images obtained by imaging an imaging region from a plurality of viewpoint positions on a first display unit, in which the first control unit performs a control of displaying first specific information for specifying a first viewpoint position in the first viewpoint video in a case in which the first viewpoint position indicated by the acquired first viewpoint position information is included in the first viewpoint video and performs a control of changing a display size of the first specific information depending on an angle of view of the first viewpoint video displayed on the first display unit. ## Claims ### Claim 1 A display control device comprising: a processor; and a memory connected to or built in the processor, wherein the processor acquires first viewpoint position information indicating a first viewpoint position of a first person with respect to an imaging region, performs a control of causing a first display capable of displaying a video visually recognized by a second person different from the first person to display a first viewpoint video selected from among a plurality of viewpoint videos generated based on images obtained by imaging the imaging region from a plurality of viewpoint positions different from each other, and performs a control of displaying first specific information for specifying the first viewpoint position indicated by the acquired first viewpoint position information in the first viewpoint video and performs a control of changing a display size of the first specific information depending on an angle of view of the first viewpoint video displayed on the first display in a case in which the first viewpoint position indicated by the acquired first viewpoint position information is included in the first viewpoint video. ### Claim 2 (depends on 1) The display control device according to claim 1, wherein the processor performs a control of setting a degree of difference between an image quality of the first viewpoint video and an image quality of the first specific information within a first predetermined range. ### Claim 3 (depends on 1) The display control device according to claim 1, wherein the processor performs a control of changing a display aspect of the first specific information depending on a relationship between a display size of the first viewpoint video and the display size of the first specific information. ### Claim 4 (depends on 3) The display control device according to claim 3, wherein the processor changes the display aspect of the first specific information by performing a control of hiding the first specific information, performing a control of displaying only an outline of the first specific information, or performing a control of translucently displaying the first specific information in a case in which a ratio of the display size of the first specific information to the display size of the first viewpoint video is equal to or more than a first threshold value. ### Claim 5 (depends on 3) The display control device according to claim 3, wherein the processor changes the display aspect of the first specific information depending on the relationship between the display size of the first viewpoint video and the display size of the first specific information and a relationship between a display position of the first viewpoint video and a display position of the first specific information. ### Claim 6 (depends on 3) The display control device according to claim 3, wherein the processor performs a control of displaying the first specific information in a display aspect emphasized more than other regions in the first viewpoint video in a case in which a ratio of the display size of the first specific information to the display size of the first viewpoint video is less than a second threshold value. ### Claim 7 (depends on 1) The display control device according to claim 1, wherein the first display is provided in a first head mounted display mounted on the second person. ### Claim 8 (depends on 1) The display control device according to claim 1, wherein the first viewpoint video is a viewpoint video selected from among the plurality of viewpoint videos in response to a first instruction for selecting any one of the plurality of viewpoint videos, which is received by a first reception device capable of receiving the first instruction. ### Claim 9 (depends on 1) The display control device according to claim 1, wherein the processor further acquires first visual line direction information indicating a first visual line direction of the first person with respect to the imaging region, and the first specific information includes information for specifying the first visual line direction indicated by the first visual line direction information acquired by the processor. ### Claim 10 (depends on 1) The display control device according to claim 1, wherein each of the plurality of viewpoint videos has peculiar viewpoint position information indicating a peculiar viewpoint position, each of the plurality of viewpoint videos is a video showing the imaging region observed from the corresponding peculiar viewpoint position, and the first viewpoint position information is the peculiar viewpoint position information of any one of the plurality of viewpoint videos. ### Claim 11 (depends on 10) The display control device according to claim 10, wherein the processor acquires the peculiar viewpoint position information corresponding to a second viewpoint video selected from among the plurality of viewpoint videos, which is displayed on a second display capable of displaying a video visually recognized by the first person and the second viewpoint video, as the first viewpoint position information. ### Claim 12 (depends on 1) The display control device according to claim 1, wherein the processor further acquires first visual line direction information indicating a first visual line direction of the first person with respect to the imaging region, the first specific information includes information for specifying the first visual line direction indicated by the first visual line direction information acquired by the processor, and the processor acquires information indicating a direction facing a second viewpoint video selected from among the plurality of viewpoint videos, which is displayed on a second display capable of displaying a video visually recognized by the first person and the second viewpoint video, as the first visual line direction information. ### Claim 13 (depends on 12) The display control device according to claim 12, wherein the second display is provided in a second head mounted display mounted on the first person. ### Claim 14 (depends on 11) The display control device according to claim 11, wherein the second viewpoint video is a viewpoint video selected from among the plurality of viewpoint videos in response to a second instruction for selecting any one of the plurality of viewpoint videos, which is received by a second reception device capable of receiving the second instruction. ### Claim 15 (depends on 1) The display control device according to claim 1, wherein the processor acquires second viewpoint position information indicating a second viewpoint position of the second person with respect to the imaging region, performs a control of causing a second display capable of displaying a video visually recognized by the first person to display a second viewpoint video selected from among the plurality of viewpoint videos, and performs a control of displaying second specific information for specifying the second viewpoint position indicated by the acquired second viewpoint position information in the second viewpoint video and performs a control of changing a display size of the second specific information depending on an angle of view of the second viewpoint video displayed on the second display in a case in which the second viewpoint position indicated by the acquired second viewpoint position information is included in the second viewpoint video. ### Claim 16 (depends on 15) The display control device according to claim 15, wherein the processor performs a control of setting a degree of difference between an image quality of the second viewpoint video and an image quality of the second specific information within a second predetermined range. ### Claim 17 (depends on 15) The display control device according to claim 15, wherein the processor performs a control of changing a display aspect of the second specific information depending on a relationship between a display size of the second viewpoint video and the display size of the second specific information. ### Claim 18 (depends on 17) The display control device according to claim 17, wherein the processor changes the display aspect of the second specific information by performing a control of hiding the second specific information, performing a control of displaying only an outline of the second specific information, or performing a control of translucently displaying the second specific information in a case in which a ratio of the display size of the second specific information to the display size of the second viewpoint video is equal to or more than a third threshold value. ### Claim 19 (depends on 15) The display control device according to claim 15, wherein the processor changes the display aspect of the second specific information depending on a relationship between a display size of the second viewpoint video and the display size of the second specific information and a relationship between a display position of the second viewpoint video and a display position of the second specific information. ### Claim 20 (depends on 17) The display control device according to claim 17, wherein the processor performs a control of displaying the second specific information in a display aspect emphasized more than other regions in the second viewpoint video in a case in which a ratio of the display size of the second specific information to the display size of the second viewpoint video is less than a fourth threshold value. ### Claim 21 (depends on 15) The display control device according to claim 15, wherein the processor further acquires second visual line direction information indicating a second visual line direction of the second person with respect to the imaging region, and the second specific information includes information for specifying the second visual line direction indicated by the second visual line direction information acquired by the processor. ### Claim 22 (depends on 15) The display control device according to claim 15, wherein each of the plurality of viewpoint videos has peculiar viewpoint position information indicating a peculiar viewpoint position, each of the plurality of viewpoint videos is a video showing the imaging region observed from the corresponding peculiar viewpoint position, and each of the first viewpoint position information and the second viewpoint position information is the peculiar viewpoint position information of any one of the plurality of viewpoint videos. ### Claim 23 (depends on 22) The display control device according to claim 22, wherein the processor acquires the peculiar viewpoint position information corresponding to the second viewpoint video selected from among the plurality of viewpoint videos, which is displayed on the second display capable of displaying the video visually recognized by the first person and the second viewpoint video, as the first viewpoint position information, and the processor acquires the peculiar viewpoint position information corresponding to the first viewpoint video displayed on the first display as the second viewpoint position information. ### Claim 24 (depends on 15) The display control device according to claim 15, wherein the processor further acquires first visual line direction information indicating a first visual line direction of the first person with respect to the imaging region, the first specific information includes information for specifying the first visual line direction indicated by the first visual line direction information acquired by the processor, the processor acquires information indicating a direction facing the second viewpoint video displayed on the second display as the first visual line direction information, the processor further acquires second visual line direction information indicating a second visual line direction of the second person with respect to the imaging region, the second specific information includes information for specifying the second visual line direction indicated by the second visual line direction information acquired by the processor, and the processor acquires information indicating a direction facing the first viewpoint video displayed on the first display as the second visual line direction information. ### Claim 25 (depends on 15) The display control device according to claim 15, wherein the second display is provided in a second head mounted display mounted on the first person. ### Claim 26 (depends on 15) The display control device according to claim 15, wherein the second viewpoint video is a viewpoint video selected from among the plurality of viewpoint videos in response to a second instruction for selecting any one of the plurality of viewpoint videos, which is received by a second reception device capable of receiving the second instruction. ### Claim 27 (depends on 15) The display control device according to claim 15, wherein the processor performs setting for hiding the second specific information in a case in which a first predetermined condition is satisfied. ### Claim 28 (depends on 1) The display control device according to claim 1, wherein a viewpoint position of at least one of the first person or the second person with respect to the imaging region is limited to a partial region of the imaging region. ### Claim 29 (depends on 1) The display control device according to claim 1, wherein the processor performs setting for hiding the first specific information in a case in which a second predetermined condition is satisfied. ### Claim 30 (depends on 1) The display control device according to claim 1, wherein at least one of the plurality of viewpoint videos is a virtual viewpoint video. ### Claim 31 A display control method comprising: acquiring first viewpoint position information indicating a first viewpoint position of a first person with respect to an imaging region; performing a control of causing a first display capable of displaying a video visually recognized by a second person different from the first person to display a first viewpoint video selected from among a plurality of viewpoint videos generated based on images obtained by imaging the imaging region from a plurality of viewpoint positions different from each other; and performing a control of displaying first specific information for specifying the first viewpoint position indicated by the acquired first viewpoint position information in the first viewpoint video and performing a control of changing a display size of the first specific information depending on an angle of view of the first viewpoint video displayed on the first display in a case in which the first viewpoint position indicated by the acquired first viewpoint position information is included in the first viewpoint video. ### Claim 32 A non-transitory computer-readable storage medium storing a program for causing a computer to execute a process comprising: acquiring first viewpoint position information indicating a first viewpoint position of a first person with respect to an imaging region; performing a control of causing a first display capable of displaying a video visually recognized by a second person different from the first person to display a first viewpoint video selected from among a plurality of viewpoint videos generated based on images obtained by imaging the imaging region from a plurality of viewpoint positions different from each other; and performing a control of displaying first specific information for specifying the first viewpoint position indicated by the acquired first viewpoint position information in the first viewpoint video and performing a control of changing a display size of the first specific information depending on an angle of view of the first viewpoint video displayed on the first display in a case in which the first viewpoint position indicated by the acquired first viewpoint position information is included in the first viewpoint video.