# US 2023/0274470 A1 · Imaging apparatus, information processing apparatus, control method, and storage medium

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0274470 A1
- Document ID: US20230274470A1
- Status: Published application
- Kind: A1
- Application number: 18/172,977
- Filed: 2023-02-22
- Published: 2023-08-31
- Earliest claimed: 2022-02-25
- Assignees: Canon Kabushiki Kaisha
- Applicants: Canon Kabushiki Kaisha
- Inventors: KENTA NAKAMURA
- Web page: https://patentgrep.com/patent/US20230274470A1

## CPC

- G06T 11/00: Two-dimensional [2D] image generation
- G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80)
- H04N 5/2224: {related to virtual studio applications}
- H04N 23/661: Transmitting camera control signals through networks, e.g. control via the Internet
- H04N 23/69: Control of means for changing angle of the field of view, e.g. optical zoom objectives or electronic zooming
- H04N 23/695: Control of camera direction for changing a field of view, e.g. pan, tilt or based on tracking of objects
- G06T 2207/20221: Image fusion; Image merging
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

An imaging apparatus configured to communicate with an information processing apparatus that generates an image, based on information about a viewpoint position set in a virtual space, the imaging apparatus includes an imaging unit configured to capture an image of a subject formed by an imaging optical system, a drive unit configured to rotate an imaging direction of the imaging unit in a pan direction or a tilt direction, an acquisition unit configured to acquire a position that does not change by rotation of the drive unit as a reference position, and acquire a position of an entrance pupil of the imaging optical system with respect to the reference position, and an output unit configured to output information including the position of the entrance pupil to the information processing apparatus, wherein the viewpoint position is set based on the position of the entrance pupil.

## Claims

### Claim 1

An imaging apparatus configured to communicate with an information processing apparatus that generates an image, based on information about a viewpoint position set in a virtual space, the imaging apparatus comprising:
an imaging unit configured to capture an image of a subject formed by an imaging optical system;
a drive unit configured to rotate an imaging direction of the imaging unit in a pan direction or a tilt direction;
at least one processor; and
a memory coupled to the at least one processor, the memory having instructions that, when executed by the processor, performs operations as:
an acquisition unit configured to acquire a position that does not change by rotation of the drive unit as a reference position, and acquire a position of an entrance pupil of the imaging optical system with respect to the reference position; and
an output unit configured to output information including the position of the entrance pupil to the information processing apparatus,
wherein the viewpoint position is set based on the position of the entrance pupil.

### Claim 2 (depends on 1)

The imaging apparatus according to claim 1, wherein the output unit is configured to output the information which includes at least one of an angle of the pan direction of the drive unit, an angle of the tilt direction of the drive unit, and a zoom position and a focus position of the imaging optical system.

### Claim 3 (depends on 1)

The imaging apparatus according to claim 1, wherein the output unit is configured to output the information which includes a position of the imaging apparatus, the position being corrected based on the position of the entrance pupil acquired by the acquisition unit.

### Claim 4 (depends on 1)

The imaging apparatus according to claim 1, wherein the acquisition unit is configured to acquire the position of the entrance pupil, the position being transformed based on an angle of the tilt direction and an angle of the pan direction of the drive unit.

### Claim 5 (depends on 1)

The imaging apparatus according to claim 1, wherein the acquisition unit is configured to acquire the position of the entrance pupil, the position corresponding to a zoom position and a focus position of the imaging optical system.

### Claim 6 (depends on 1)

The imaging apparatus according to claim 1,
wherein, the acquisition unit is configured to acquire a position of a rotation axis of the drive unit in the pan direction and a position of a rotation axis of the drive unit in the tilt direction and wherein, in a case where the rotation axis of the pan direction and the rotation axis of the tilt direction do not intersect, the position of the rotation axis of the pan direction and the position of the rotation axis of the tilt direction are transformed to intersect at a predetermined position, and
wherein the output unit is configured to output information including a position of the entrance pupil with respect to the predetermined position, as the information about the viewpoint position.

### Claim 7 (depends on 1)

An information processing apparatus that communicate with the imaging apparatus according to claim 1, the information processing apparatus comprising:
at least one processor; and
a memory coupled to the at least one processor, the memory having instructions that, when executed by the processor, performs operations as:
an acquisition unit configured to acquire information about a viewpoint position in a virtual space output from the imaging apparatus and an image captured by the imaging apparatus;
a setting unit configured to set the information about the viewpoint position acquired by the acquisition unit; and
a generation unit configured to generate an image of the virtual space, based on the information about the viewpoint position set by the setting unit, and generate a combined image in which the image of the virtual space and the image captured by the imaging apparatus are combined.

### Claim 8

A control method for an imaging apparatus that communicates with an information processing apparatus that generates an image, based on information about a viewpoint position set in a virtual space, the control method comprising:
acquiring a position of an entrance pupil of an imaging optical system with respect to a reference position, using a position that does not change by rotation in a pan direction or a tilt direction in the imaging apparatus, as the reference position; and
outputting information including the position of the entrance pupil with respect to the reference position to the information processing apparatus.

### Claim 9 (depends on 8)

The control method according to claim 8, wherein the output information includes at least one of an angle of the pan direction, an angle of the tilt direction, and a zoom position and a focus position of the imaging optical system.

### Claim 10 (depends on 8)

The control method according to claim 8, wherein the output information includes a position of the imaging apparatus, the position being corrected based on the acquired position of the entrance pupil.

### Claim 11 (depends on 8)

The control method according to claim 8, wherein the acquired position of the entrance pupil is a position transformed based on an angle of the pan direction and an angle of the tilt direction.

### Claim 12 (depends on 8)

The control method according to claim 8, wherein the acquired position of the entrance pupil corresponds to a zoom position and a focus position of the imaging optical system.

### Claim 13 (depends on 8)

The control method according to claim 8,
wherein a position of a rotation axis of the pan direction and a position of a rotation axis of the tilt direction are acquired and wherein, in a case where the rotation axis of the pan direction and the rotation axis of the tilt direction do not intersect, the position of the rotation axis of the pan direction and the position of the rotation axis of the tilt direction are transformed to intersect at a predetermined position, and
wherein information including a position of the entrance pupil with respect to the predetermined position is output as the information about the viewpoint position.

### Claim 14

A non-transitory computer-readable storage medium storing a program for causing a computer to execute a method comprising:
acquiring a position of an entrance pupil of an imaging optical system with respect to a reference position, using a position that does not change by rotation in a pan direction or a tilt direction, as the reference position, in an imaging apparatus; and
outputting information including the position of the entrance pupil to an information processing apparatus.
