# US 12,701,206 B2 · Information processing apparatus, information processing method, and program > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,701,206 B2 - Document ID: US12701206B2 - Status: Granted - Kind: B2 - Application number: 18/965,926 - Filed: 2024-12-02 - Published: 2025-03-20 - Granted: 2026-08-04 - Earliest claimed: 2019-07-26 - Assignees: FUJIFILM Corporation - Applicants: Fujifilm Corporation - Inventors: Kazunori Tamura; Fuminori Irie; Takashi Aoki; Masahiko Miyata - Web page: https://patentgrep.com/patent/US12701206B2 ## CPC - H04N 13/117: the virtual viewpoint locations being selected by the viewers or determined by viewer tracking - G06F 1/1694: {the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer} - G06F 3/0346: with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors - G06F 3/04815: Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object - G06T 15/20: Perspective computation - G06T 19/00: Manipulating three-dimensional [3D] models or images for computer graphics - H04N 7/18: Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast - H04N 21/21805: {enabling multiple viewpoints, e.g. using a plurality of cameras} - H04N 21/2187: Live feed - H04N 21/41407: {embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop (constructional details of equipment or arrangements specially adapted for portable computer application G06F1/1626; arrangements specially adapted for mobile receivers in broadcast systems H04H20/57)} - H04N 21/42224: {Touch pad or touch panel provided on the remote control} - H04N 21/816: {involving special video data, e.g 3D video} - H04N 23/90: Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums - G06F 2200/1637: Sensing arrangement for detection of housing movement or orientation, e.g. for controlling scrolling or cursor movement on the display of an handheld computer - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL ## Abstract An information processing apparatus includes an acquisition unit that acquires a free viewpoint video based on at least one image among a plurality of images obtained by imaging an imaging region by a plurality of imaging apparatuses, and a reference video, the free viewpoint video indicating the imaging region in a case in which the imaging region is observed from a specific viewpoint position and a specific visual line direction, and an execution unit that executes a specific process in a case in which a difference degree between the free viewpoint video acquired by the acquisition unit and the reference video acquired by the acquisition unit is equal to or more than a first threshold value. ## Claims ### Claim 1 An information processing apparatus comprising: a processor; and a memory built in or connected to the processor, wherein the processor is configured to: acquire a free viewpoint video based on at least one image among a plurality of images obtained by imaging an imaging region by a plurality of imaging apparatuses, and a reference video, the free viewpoint video indicating the imaging region in a case in which the imaging region is observed from a specific viewpoint position and a specific visual line direction, and execute a specific process in a case in which a degree of similarity between the acquired free viewpoint video and the acquired reference video is less than a first threshold value, the specific process being a process that contributes to setting the degree of similarity to be equal to or more than the first threshold value. ### Claim 2 (depends on 1) The information processing apparatus according to claim 1, wherein the specific process is a process including a notification process of giving notification based on the degree of similarity being less than the first threshold value. ### Claim 3 (depends on 2) The information processing apparatus according to claim 2, wherein the notification process is a process of giving at least one of visible notification, audible notification, or tactile notification based on the degree of similarity being less than the first threshold value. ### Claim 4 (depends on 1) The information processing apparatus according to claim 1, wherein the specific process is a process including a process of limiting a range in which the viewpoint position is able to be indicated to a viewpoint position range determined as a range in which the degree of similarity is set to be equal to or more than the first threshold value, and limiting a range in which the visual line direction is able to be indicated to a visual line direction range determined as a range in which the degree of similarity is set to be equal to or more than the first threshold value. ### Claim 5 (depends on 1) The information processing apparatus according to claim 1, wherein the specific process is a process including a change process of performing, on the free viewpoint video change for setting the difference degree to be less than the first threshold value. ### Claim 6 (depends on 5) The information processing apparatus according to claim 5, wherein the change process is a process of changing the free viewpoint video by changing at least one of the viewpoint position or the visual line direction. ### Claim 7 (depends on 1) The information processing apparatus according to claim 1, wherein the processor is configured to execute the specific process depending on a change in the free viewpoint video. ### Claim 8 (depends on 7) The information processing apparatus according to claim 7, wherein the processor selectively sets a following mode in which the processor executes the specific process while following the change in the free viewpoint video, and a non-following mode in which the processor does not execute the specific process while following the change in the free viewpoint video. ### Claim 9 (depends on 8) The information processing apparatus according to claim 8, wherein the processor is configured to set the following mode in a case in which a change amount of the degree of similarity is less than a second threshold value, and sets the non-following mode in a case in which the change amount is equal to or more than the second threshold value. ### Claim 10 (depends on 8) The information processing apparatus according to claim 8, wherein the processor is configured to set the following mode in a case in which a frequency at which the degree of similarity changes is less than a third threshold value, and sets the non-following mode in a case in which the frequency is equal to or more than the third threshold value. ### Claim 11 (depends on 1) The information processing apparatus according to claim 1, wherein the processor is configured to further display the free viewpoint video on a first display device. ### Claim 12 (depends on 11) The information processing apparatus according to claim 11, wherein: the first display device includes a detector that detects a posture of the first display device, and the processor is configured to execute the specific process in a case in which the posture detected by the detector is a predetermined posture, and does not execute the specific process in a case in which the posture detected by the detector is a posture different from the predetermined posture. ### Claim 13 (depends on 11) The information processing apparatus according to claim 11, wherein the processor is configured to display the reference video on a second display device different from the first display device. ### Claim 14 (depends on 1) The information processing apparatus according to claim 1, wherein the processor is configured to execute change in the first threshold value according to instruction information for giving an instruction for changing the first threshold value received by a reception device in a case in which the instruction information is received by the reception device. ### Claim 15 (depends on 1) The information processing apparatus according to claim 1, wherein the free viewpoint video is a virtual viewpoint video. ### Claim 16 (depends on 1) The information processing apparatus according to claim 1, wherein the reference video is a live broadcast video. ### Claim 17 (depends on 1) The information processing apparatus according to claim 1, wherein the reference video is an image obtained by imaging the imaging region by a reference imaging apparatus. ### Claim 18 (depends on 1) The information processing apparatus according to claim 1, wherein the viewpoint position and the visual line direction are a viewpoint position and a visual line direction as indicated from an outside. ### Claim 19 An information processing method comprising: acquiring a free viewpoint video based on at least one image among a plurality of images obtained by imaging an imaging region by a plurality of imaging apparatuses, and a reference video, the free viewpoint video indicating the imaging region in a case in which the imaging region is observed from a specific viewpoint position and a specific visual line direction; and executing a specific process in a case in which a degree of similarity between the acquired free viewpoint video and the acquired reference video is less than a first threshold value, wherein the specific process is a process that contributes to setting the degree of similarity to be equal to or more than the first threshold value. ### Claim 20 A non-transitory computer-readable storage medium storing a program for causing a computer to execute a process comprising: acquiring a free viewpoint video based on at least one image among a plurality of images obtained by imaging an imaging region by a plurality of imaging apparatuses, and a reference video, the free viewpoint video indicating the imaging region in a case in which the imaging region is observed from a specific viewpoint position and a specific visual line direction; and executing a specific process in a case in which a degree of similarity between the acquired free viewpoint video and the acquired reference video is less than a first threshold value, wherein the specific process is a process that contributes to setting the degree of similarity to be equal to or more than the first threshold value.