# US 12,114,065 B2 · Methods and apparatus for remote camera control with intention based controls and machine learning vision state management > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,114,065 B2 - Document ID: US12114065B2 - Status: Granted - Kind: B2 - Application number: 18/123,755 - Filed: 2023-03-20 - Published: 2023-09-21 - Granted: 2024-10-08 - Earliest claimed: 2017-08-15 - Assignees: American Well Corporation - Applicants: American Well Corporation - Inventors: Ghafran Abbas - Web page: https://patentgrep.com/patent/US12114065B2 ## CPC - H04N 7/181: {for receiving images from a plurality of remote sources} - H04N 23/66: Remote control of cameras or camera parts, e.g. by remote control devices - H04N 7/147: {Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals (selecting H04Q)} - H04N 23/61: based on recognised objects - H04N 23/661: Transmitting camera control signals through networks, e.g. control via the Internet - H04N 23/69: Control of means for changing angle of the field of view, e.g. optical zoom objectives or electronic zooming - H04N 23/695: Control of camera direction for changing a field of view, e.g. pan, tilt or based on tracking of objects - H04N 23/698: for achieving an enlarged field of view, e.g. panoramic image capture - H04N 7/142: {Constructional details of the terminal equipment, e.g. arrangements of the camera and the display} - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract In some embodiments, an apparatus includes a memory and a processor. The processor is configured to receive an intent command from a control device. The processor is configured to identify, based on the intent command, a first portion of an image captured by a first image capture device and to identify, using video analytics, a second portion of the image captured by the first image capture device. The second portion is included in an image captured by a second image capture device at a first time. The processor is configured to calculate an offset between the first portion and the second portion using the image captured by the first image capture device. The processor is configured to send a signal to adjust using the offset the second image capture device to capture an image including the first portion at a second time after the first time. ## Claims ### Claim 1 A data processing system, comprising: at least one processor; and a memory storing instructions that, when executed by the at least one processor cause the at least one processor to perform operations comprising: receiving, at a user interface, a command from a control device; identifying, based on the command, a first portion of a first image captured by a first camera, with the first image representing one or more objects; based on the command, causing presentation, in the user interface, the first image captured by the first camera and one or more controls for selection of an object of the one or more objects in the first image captured by the first camera; receiving, from the control device, data representing a selection through the user interface of an object of the one or more objects and an instruction to track the selected object; identifying a second portion of the first image captured by the first camera, the second portion included in a second image that is captured by a second camera; determining a spatial offset between the second portion of the first image captured by the first camera, and the first portion of the first image, the first portion representing the object selected in the user interface; and sending a signal to adjust, using the spatial offset, the second camera to capture a third image including a representation of the first portion of the first image including the selected object. ### Claim 2 (depends on 1) The data processing system of claim 1, wherein the first camera is at least one wide-angle lens camera, and the second camera is a pan-tilt-zoom (PTZ) camera. ### Claim 3 (depends on 1) The data processing system of claim 1, wherein the at least one processor is configured to send the second image captured by the second camera and including the first portion to the control device. ### Claim 4 (depends on 1) The data processing system of claim 1, wherein the at least one processor is configured to facilitate video conferencing with the control device. ### Claim 5 (depends on 1) The data processing system of claim 1, wherein the command is associated with a user of the control device selecting to view, with the second camera, the first portion of the image captured by the first camera. ### Claim 6 (depends on 1) The data processing system of claim 1, wherein the command is associated with a user of the control device selecting to view, with the second camera, an object within the image captured by the first camera. ### Claim 7 (depends on 1) The data processing system of claim 1, wherein the at least one processor is configured to identify the second portion of the image captured by the first camera by matching the image captured by the second camera to the second portion within the image captured by the first camera using a machine learning model. ### Claim 8 A method configured for execution by at least one processor, the method, comprising: receiving, at a user interface, a command from a control device; identifying, based on the command, a first portion of a first image captured by a first camera, with the first image representing one or more objects; based on the command, causing presentation, in the user interface, the first image captured by the first camera and one or more controls for selection of an object of the one or more objects in the first image captured by the first camera; receiving, from the control device, data representing a selection through the user interface of an object of the one or more objects and an instruction to track the selected object; identifying a second portion of the first image captured by the first camera, the second portion included in a second image that is captured by a second camera; determining a spatial offset between the second portion of the first image captured by the first camera, and the first portion of the first image, the first portion representing the object selected in the user interface; and sending a signal to adjust, using the spatial offset, the second camera to capture a third image including a representation of the first portion of the first image including the selected object. ### Claim 9 (depends on 8) The method of claim 8, wherein the first camera is at least one wide-angle lens camera, and the second camera is a pan-tilt-zoom (PTZ) camera. ### Claim 10 (depends on 8) The method of claim 8, wherein the at least one processor is configured to send the second image captured by the second camera and including the first portion to the control device. ### Claim 11 (depends on 8) The method of claim 8, wherein the at least one processor is configured to facilitate video conferencing with the control device. ### Claim 12 (depends on 8) The method of claim 8, wherein the command is associated with a user of the control device selecting to view, with the second camera, the first portion of the image captured by the first camera. ### Claim 13 (depends on 8) The method of claim 8, wherein the command is associated with a user of the control device selecting to view, with the second camera, an object within the image captured by the first camera. ### Claim 14 (depends on 8) The method of claim 8, wherein the at least one processor is configured to identify the second portion of the image captured by the first camera by matching the image captured by the second camera to the second portion within the image captured by the first camera using a machine learning model. ### Claim 15 One or more non-transitory computer readable media storing instructions that, when executed by at least one processor, cause the at least one processor to perform operations comprising: receiving, at a user interface, a command from a control device; identifying, based on the command, a first portion of a first image captured by a first camera, with the first image representing one or more objects; based on the command, causing presentation, in the user interface, the first image captured by the first camera and one or more controls for selection of an object of the one or more objects in the first image captured by the first camera; receiving, from the control device, data representing a selection through the user interface of an object of the one or more objects and an instruction to track the selected object; identifying a second portion of the first image captured by the first camera, the second portion included in a second image that is captured by a second camera; determining a spatial offset between the second portion of the first image captured by the first camera, and the first portion of the first image, the first portion representing the object selected in the user interface; and sending a signal to adjust, using the spatial offset, the second camera to capture a third image including a representation of the first portion of the first image including the selected object. ### Claim 16 (depends on 15) The one or more non-transitory computer readable media of claim 15, wherein the first camera is at least one wide-angle lens camera, and the second camera is a pan-tilt-zoom (PTZ) camera. ### Claim 17 (depends on 15) The one or more non-transitory computer readable media of claim 15, wherein the at least one processor is configured to send the second image captured by the second camera and including the first portion to the control device. ### Claim 18 (depends on 15) The one or more non-transitory computer readable media of claim 15, wherein the at least one processor is configured to facilitate video conferencing with the control device. ### Claim 19 (depends on 15) The one or more non-transitory computer readable media of claim 15, wherein the command is associated with a user of the control device selecting to view, with the second camera, the first portion of the image captured by the first camera. ### Claim 20 (depends on 15) The one or more non-transitory computer readable media of claim 15, wherein the command is associated with a user of the control device selecting to view, with the second camera, an object within the image captured by the first camera.