# US 11,445,119 B2 · Image capturing control apparatus, image capturing control method, and storage medium > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 11,445,119 B2 - Document ID: US11445119B2 - Status: Granted - Kind: B2 - Application number: 17/474,754 - Filed: 2021-09-14 - Published: 2022-03-24 - Granted: 2022-09-13 - Earliest claimed: 2020-09-18 - Assignees: Canon Kabushiki Kaisha - Applicants: Canon Kabushiki Kaisha - Inventors: Takuya Toyoda - Web page: https://patentgrep.com/patent/US11445119B2 ## CPC - H04N 7/183: {for receiving images from a single remote source} - H04N 23/69: Control of means for changing angle of the field of view, e.g. optical zoom objectives or electronic zooming - H04N 7/185: {from a mobile camera, e.g. for remote control} - H04N 23/611: where the recognised objects include parts of the human body - H04N 23/661: Transmitting camera control signals through networks, e.g. control via the Internet - H04N 23/695: Control of camera direction for changing a field of view, e.g. pan, tilt or based on tracking of objects - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract An image capturing control apparatus is provided and detects a first target subject and a second target subject, converts intra-angle-of-view coordinates of each of the first and second target subjects into pan and tilt coordinate values, store the pan coordinate value and the tilt coordinate value of each of the first and the second target subject, determine an angle of view so as to include the first and second target subjects based on the stored pan and tilt coordinate values, and control an angle of view of the image capturing apparatus based on the determined angle of view. ## Claims ### Claim 1 An image capturing control apparatus comprising: one or more memories having instructions stored therein; and one or more processors that, upon execution of the stored instructions; configures the apparatus to: detect a first target subject from an image captured by an image capturing unit in a state of a first angle of view of the image capturing unit; detect a second target subject from an image captured by the image capturing unit in a state of a second angle of view of the image capturing unit; convert intra-angle-of-view coordinates of each of the first target subject in the first angle of view and the second target subject in the second angle of view into a pan coordinate value and a tilt coordinate value; store the pan coordinate value and the tilt coordinate value of each of the first target subject and the second target subject; determine an angle of view so as to include the first target subject and the second target subject based on the stored pan coordinate value and the stored tilt coordinate value of each of the first target subject and the second target subject, even if a current angle of view of the imaging unit does not include at least one of the first target subject and the second target subject; and control an angle of view of the image capturing unit based on the determined angle of view. ### Claim 2 (depends on 1) The image capturing control apparatus according to claim 1, wherein execution of the stored instructions further configures the apparatus to extract a region of interest from an image captured by the image capturing unit, wherein an angle of view so as to include the first target subject and the region of interest is determined. ### Claim 3 (depends on 2) The image capturing control apparatus according to claim 2, wherein the region of interest is extracted from the second target subject. ### Claim 4 (depends on 2) The image capturing control apparatus according to claim 2, wherein execution of the stored instructions further configures the apparatus to determine the angle of view such that the first target subject does not lie at edge of the angle of view and the region of interest lies at edge of the angle of view. ### Claim 5 (depends on 4) The image capturing control apparatus according to claim 4, wherein execution of the stored instructions further configures the apparatus to slide the determined angle of view which has been determined so as to include the first target subject and the second target subject, such that the region of interest lies at edge of an angle of view, thus determining the angle of view such that the first target subject does not lie at edge of an angle of view end and the region of interest lies at edge of an angle of view. ### Claim 6 (depends on 2) The image capturing control apparatus according to claim 2, wherein the region of interest is extracted based on luminance information in an image captured by the image capturing unit. ### Claim 7 (depends on 1) The image capturing control apparatus according to claim 1, wherein execution of the stored instructions further configures the apparatus to determine the angle of view such that a distance from the first target subject to edge of an angle of view has room corresponding to a width of the first target subject. ### Claim 8 (depends on 1) The image capturing control apparatus according to claim 1, wherein execution of the stored instructions further configures the apparatus to determine the angle of view so as to include the first target subject and the second target subject, based on a movement history of the first target subject in a given period. ### Claim 9 (depends on 8) The image capturing control apparatus according to claim 8, wherein the movement history of the first target subject includes a plurality of a pan coordinate value and a tilt coordinate value of the first target subject obtained in the given period. ### Claim 10 (depends on 1) The image capturing control apparatus according to claim 1, wherein execution of the stored instructions further configures the apparatus to determine the angle of view so as to include the first target subject and the second target subject, further based on an aspect ratio of an image captured by the imaging unit. ### Claim 11 (depends on 10) The image capturing control apparatus according to claim 10, wherein execution of the stored instructions further configures the apparatus to determine, based on the aspect ratio, whether the first target subject and the second target subject protrude from a current angle of view, and, when it is determined that the first target subject and the second target subject protrude from the current angle of view, an angle of view from which the first target subject and the second target subject do not protrude is determined. ### Claim 12 (depends on 1) The image capturing control apparatus according to claim 1, wherein the determined angle of view includes an entire region of the first target subject and an entire region of the second target subject. ### Claim 13 An image capturing control method to be performed by an image capturing control apparatus which controls an image capturing unit, the image capturing control method comprising: detecting a first target subject from an image captured by the image capturing unit in a state of a first angle of view of the image capturing unit; detecting a second target subject from an image captured by the image capturing unit in a state of a second angle of view of the image capturing unit; converting intra-angle-of-view coordinates of each of the first target subject in the first angle of view and the second target subject in the second angle of view into a pan coordinate value and a tilt coordinate value; storing the pan coordinate value and the tilt coordinate value of each of the first target subject and the second target subject; determining an angle of view so as to include the first target subject and the second target subject based on the stored pan coordinate value and the stored tilt coordinate value of each of the first target subject and the second target subject, even if a current angle of view of the imaging unit does not include at least one of the first target subject and the second target subject; and controlling an angle of view of the image capturing unit based on the determined angle of view. ### Claim 14 A non-transitory computer-readable storage medium storing computer-executable instructions that, when executed by a computer, cause the computer to perform an image capturing control method for controlling an image capturing unit, the image capturing control method comprising: detecting a first target subject from an image captured by the image capturing unit in a state of a first angle of view of the image capturing unit; detecting a second target subject from an image captured by the image capturing unit in a state of a second angle of view of the image capturing unit; converting intra-angle-of-view coordinates of each of the first target subject in the first angle of view and the second target subject in the second angle of view into a pan coordinate value and a tilt coordinate value; storing the pan coordinate value and the tilt coordinate value of each of the first target subject and the second target subject; determining an angle of view so as to include the first target subject and the second target subject based on the stored pan coordinate value and the stored tilt coordinate value of each of the first target subject and the second target subject, even if a current angle of view of the imaging unit does not include at least one of the first target subject and the second target subject; and controlling an angle of view of the image capturing unit based on the determined angle of view.