# US 12,120,418 B2 · Information processing apparatus for controlling an image capturing area, information processing method, and storage medium > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,120,418 B2 - Document ID: US12120418B2 - Status: Granted - Kind: B2 - Application number: 17/935,797 - Filed: 2022-09-27 - Published: 2023-03-30 - Granted: 2024-10-15 - Earliest claimed: 2021-09-28 - Assignees: Canon Kabushiki Kaisha - Applicants: Canon Kabushiki Kaisha - Inventors: Kenshiro Mizuma - Web page: https://patentgrep.com/patent/US12120418B2 ## CPC - H04N 23/632: {for displaying or modifying preview images prior to image capturing, e.g. variety of image resolutions or capturing parameters} - H04N 23/69: Control of means for changing angle of the field of view, e.g. optical zoom objectives or electronic zooming - H04N 23/611: where the recognised objects include parts of the human body - H04N 23/62: Control of parameters via user interfaces - H04N 23/631: {Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters} - H04N 23/635: {Region indicators; Field of view indicators} - H04N 23/695: Control of camera direction for changing a field of view, e.g. pan, tilt or based on tracking of objects - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract An information processing apparatus that communicates with an image capturing apparatus that includes an image capturing unit causes a display unit to display a first window including an image captured by the image capturing unit and a second window including an icon for controlling an image capturing area of the image capturing unit, receives a user operation for designating a position of the icon in the second window displayed on the display unit, and controls the image capturing area of the image capturing unit based on a position of the icon in the second window that is based on the received user operation and a position of a target object detected from a captured image. ## Claims ### Claim 1 An information processing apparatus that communicates with an image capturing apparatus including an image capturing unit, the information processing apparatus comprising: a memory; and a processor configured to communicate with the memory, wherein the processor executes a program stored in the memory to cause the information processing apparatus to: cause a display unit to display a first window including an image captured by the image capturing unit and a second window including an icon representing a target object detected from the image captured by the image capturing unit; receive a user operation to change a position of the icon in the second window displayed on the display unit; control an image capturing area of the image capturing unit based on the user operation so that the target object is positioned at a corresponding area of the image indicated by the position of the icon in the second window; and control the image capturing area of the image capturing unit in accordance with a movement of the target object so that the image capturing unit continues to capture the target object at the corresponding area of the image, wherein an image capturing direction of the image capturing apparatus is controlled to position the target object in the first window to the identical position of the icon in the second window. ### Claim 2 (depends on 1) The information processing apparatus according to claim 1, wherein the first window and the second window are displayed on the display unit in side by side arrangement. ### Claim 3 (depends on 1) The information processing apparatus according to claim 1, wherein the image capturing area is controlled to track the target object so that the position of the icon in the second window corresponds to the position of the detected target object. ### Claim 4 (depends on 1) The information processing apparatus according to claim 1, wherein the image capturing area is controlled such that a ratio of a size of the target object in the captured image to a size of the captured image and a ratio of a size of the icon in the second window to a size of the second window correspond to each other. ### Claim 5 (depends on 1) The information processing apparatus according to claim 1, wherein the information processing apparatus specifies the target object from among objects detected from an image captured by the image capturing unit. ### Claim 6 (depends on 5) The information processing apparatus according to claim 5, wherein the information processing apparatus acquires a detection result of an object in the captured image, wherein the information processing apparatus causes the display unit to display the first window including the captured image on which a frame indicating a position of the object detected from the captured image has been superimposed based on the detection result, and wherein, in a case where a user operation for designating a specific frame with respect to the captured image, on which the frame indicating the position of the object has been superimposed, is received, an object corresponding to the designated specific frame is specified as the target object. ### Claim 7 (depends on 1) The information processing apparatus according to claim 1, wherein the icon is a clipped image of the target object in the captured image. ### Claim 8 (depends on 1) The information processing apparatus according to claim 1, wherein the target object is a person and the icon is a mark obtained by imitating a person. ### Claim 9 (depends on 1) The information processing apparatus according to claim 1, wherein an aspect ratio of the captured image and an aspect ratio of the second window are identical. ### Claim 10 (depends on 1) The information processing apparatus according to claim 1, wherein a display form of a first area in which the icon is restricted from being located in the second window is different from a display form of an area other than the first area. ### Claim 11 (depends on 10) The information processing apparatus according to claim 10, wherein the first area in which the icon is restricted from being located is an area that is specified based on a drivable range of the image capturing unit. ### Claim 12 (depends on 1) The information processing apparatus according to claim 1, wherein the image capturing direction of the image capturing apparatus is the direction in which the optical axis of a lens is directed by a pan, tilt, and zoom control. ### Claim 13 An information processing method comprising: causing a display unit to display a first window including an image captured by an image capturing unit and a second window including an icon representing a target object detected from the image captured by the image capturing unit; and receiving a user operation to change a position of the icon in the second window displayed on the display unit; controlling an image capturing area of the image capturing unit based on the user operation so that the target object is positioned at a corresponding area of the image indicated by the position of the icon in the second window; and control the image capturing area of the image capturing unit in accordance with a movement of the target object so that the image capturing unit continues to capture the target object at the corresponding area of the image, wherein an image capturing direction of the image capturing apparatus is controlled to position the target object in the first window to the identical position of the icon in the second window. ### Claim 14 A non-transitory computer-readable storage medium storing computer-executable instructions that, when executed by a computer, cause the computer to perform a method, the method comprising: causing a display unit to display a first window including an image captured by an image capturing unit and a second window including an icon representing a target object detected from the image captured by the image capturing unit; receiving a user operation to change a position of the icon in the second window displayed on the display unit; controlling an image capturing area of the image capturing unit based on the user operation so that the target object is positioned at a corresponding area of the image indicated by the position of the icon in the second window; and control the image capturing area of the image capturing unit in accordance with a movement of the target object so that the image capturing unit continues to capture the target object at the corresponding area of the image, wherein an image capturing direction of the image capturing apparatus is controlled to position the target object in the first window to the identical position of the icon in the second window.