# US 2021/0243364 A1 · Management of video data processing resources across multiple processing locations > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2021/0243364 A1 - Document ID: US20210243364A1 - Status: Published application - Kind: A1 - Application number: 16/782,624 - Filed: 2020-02-05 - Published: 2021-08-05 - Earliest claimed: 2020-02-05 - Assignees: Dragonfruit Ai, Inc. - Applicants: Dragonfruit Ai, Inc - Inventors: Amit Kumar - Web page: https://patentgrep.com/patent/US20210243364A1 ## CPC - G06F 9/5044: {considering hardware capabilities} - G06F 11/3433: {for load management (allocation of a server based on load conditions G06F9/505; load rebalancing G06F9/5083; redistributing the load in a network by a load balancer H04L67/1029)} - H04N 21/21805: {enabling multiple viewpoints, e.g. using a plurality of cameras} - H04N 21/23: Processing of content or additional data; Elementary server operations; Server middleware - H04N 21/24: Monitoring of processes or resources, e.g. monitoring of server load, available bandwidth, upstream requests {(monitoring of server performance or load G06F11/34; arrangements for observation, testing or troubleshooting for broadcast or for distribution combined with broadcast H04H20/12)} - H04N 23/661: Transmitting camera control signals through networks, e.g. control via the Internet - G06Q 10/0631: Resource planning, allocation, distributing or scheduling for enterprises or organisations - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR ## Abstract Systems, methods, and software described herein manage video data processing resources for video data obtained from one or more sources. In one implementation, a management system may monitor processing requirements for the video data and computing resources available at multiple video processing locations. The management system may further allocate processing operations to the video processing locations based on the processing requirements for the video data and computing resources available at the video processing locations. ## Claims ### Claim 1 A method comprising: monitoring processing requirements associated with video data from one or more video sources; monitoring computing resources available at a first video processing location and at least one second video processing location; allocating first video processing operations to the first video processing location and second video processing operations to the at least one second video processing location based on the monitored processing requirements and monitored computing resources. ### Claim 2 (depends on 1) The method of claim 1, wherein the one or more video sources comprise one or more cameras. ### Claim 3 (depends on 2) The method of claim 2, wherein the first video processing location is located on the one or more cameras, and wherein the at least one second video processing location comprises a data center accessible to the first video processing location over the internet. ### Claim 4 (depends on 1) The method of claim 1 further comprising: monitoring data processing costs in association with the at least one second video processing location; and updating the first video processing operations at the first video processing location and the second video processing operations at the second video processing location based on the data processing costs. ### Claim 5 (depends on 1) The method of claim 1, wherein the first video processing location is nearer in physical proximity to the one or more video sources than the at least one second video processing location. ### Claim 6 (depends on 1) The method of claim 1 further comprising: identifying a video portion of interest using the first video processing operations at the first video processing location; and in response to identifying the video portion of interest, initiating third video processing operations at the at the at least one second video processing location. ### Claim 7 (depends on 1) The method of claim 1 further comprising: monitoring one or more networking conditions between the first video processing location and the at least one second video processing location; and wherein allocating the first video processing operations to the first video processing location and the second video processing operations to the at least one second video processing location is further based on the one or more networking conditions. ### Claim 8 (depends on 7) The method of claim 7, wherein the one or more networking conditions comprise bandwidth and/or latency. ### Claim 9 A computing apparatus comprising: a storage system: a processing system operatively coupled to the storage system; and program instructions stored on the storage system that, when executed by the processing system, direct the processing system to: monitor processing requirements associated with video data from one or more video sources; monitor computing resources available at a first video processing location and at least one second video processing location; and allocate first video processing operations to the first video processing location and second video processing operations to the at least one second video processing location based on the monitored processing requirements and monitored computing resources. ### Claim 10 (depends on 9) The computing apparatus of claim 9, wherein the one or more video sources comprise one or more cameras. ### Claim 11 (depends on 10) The computing apparatus of claim 10, wherein the first video processing location is located on the one or more cameras, and wherein the at least one second video processing location comprises a data center accessible to the first video processing location over the internet. ### Claim 12 (depends on 9) The computing apparatus of claim 9, wherein the program instructions further direct the processing system to: monitor data processing costs in association with the at least one second video processing location; and update the first video processing operations at the first video processing location and the second video processing operations at the second video processing location based on the data processing costs. ### Claim 13 (depends on 9) The computing apparatus of claim 9, wherein the first video processing location is nearer in physical proximity to the one or more video sources than the at least one second video processing location. ### Claim 14 (depends on 9) The computing apparatus of claim 9, wherein the program instructions further direct the processing system to: identify a video portion of interest using the first video processing operations at the first video processing location; and in response to identifying the video portion of interest, initiate third video processing operations at the at the at least one second video processing location. ### Claim 15 (depends on 9) The computing apparatus of claim 9, wherein the program instructions further direct the processing system to: monitor one or more networking conditions between the first video processing location and the at least one second video processing location; and wherein allocating the first video processing operations to the first video processing location and the second video processing operations to the at least one second video processing location is further based on the one or more networking conditions. ### Claim 16 (depends on 15) The computing apparatus of claim 15, wherein the one or more networking conditions comprise bandwidth and/or latency. ### Claim 17 A system comprising: one or more cameras; and a management system configured to: monitor processing requirements associated with video data from one or more video sources; monitor computing resources available at a first video processing location and at least one second video processing location; and allocate first video processing operations to the first video processing location and second video processing operations to the at least one second video processing location based on the monitored processing requirements and monitored computing resource. ### Claim 18 (depends on 17) The system of claim 17, wherein the management system is further configured to: monitor data processing costs in association with the at least one second video processing location; and update the first video processing operations at the first video processing location and the second video processing operations at the second video processing location based on the data processing costs. ### Claim 19 (depends on 17) The system of claim 17, wherein the first video processing location is nearer in physical proximity to the one or more video sources than the at least one second video processing location. ### Claim 20 (depends on 17) The system of claim 17, wherein the management system is further configured to: identify a video portion of interest using the first video processing operations at the first video processing location; and in response to identifying the video portion of interest, initiate third video processing operations at the at the at least one second video processing location.