# US 2015/0106331 A1 · Data set capture management with forecasting > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2015/0106331 A1 - Document ID: US20150106331A1 - Status: Published application - Kind: A1 - Application number: 14/574,264 - Filed: 2014-12-17 - Published: 2015-04-16 - Earliest claimed: 2010-08-26 - Assignees: Amazon Technologies, Inc. - Applicants: Amazon Technologies, Inc. - Inventors: TATE ANDREW CERTAIN; Matthew S. Garman; Sachin Jain; Fiorenzo Cattaneo - Web page: https://patentgrep.com/patent/US20150106331A1 ## CPC - G06F 16/27: Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor - G06F 3/0611: {in relation to response time} - G06F 11/1461: {Backup scheduling policy} - G06F 16/128: {Details of file system snapshots on the file-level, e.g. snapshot creation, administration, deletion (error detection or correction of the data by redundancy in operations or in hardware G06F11/14, G06F11/16)} - G06F 16/185: Hierarchical storage management [HSM] systems, e.g. file migration or policies thereof (details of archiving G06F16/11) - G06F 16/2358: {Change logging, detection, and notification (replication G06F16/27)} - G06F 11/1451: {by selection of backup contents} - G06F 11/1662: {the resynchronized component or unit being a persistent storage device (re-synchronization of failed mirror storage G06F11/2082; rebuild or reconstruction of parity RAID storage G06F11/1008)} - G06F 11/2094: {Redundant storage or storage space (G06F11/2056 takes precedence)} - G06F 11/3433: {for load management (allocation of a server based on load conditions G06F9/505; load rebalancing G06F9/5083; redistributing the load in a network by a load balancer H04L67/1029)} - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) ## Abstract A set of virtualized computing services may include multiple types of virtualized data store differentiated by characteristics such as latency, throughput, durability and cost. A sequence of captures of a data set from one data store to another may be scheduled to achieve a variety of virtualized computing service user and provider goals such as lowering a probability of data loss, lowering costs, and computing resource load leveling. Data set captures may be scheduled according to policies specifying fixed and flexible schedules and conditions including flexible scheduling windows, target capture frequencies, probability of loss targets and/or cost targets. Capture lifetimes may also be managed with capture retention policies, which may specify fixed and flexible lifetimes and conditions including cost targets. Such data set capture policies may be specified with a Web-based administrative interface to a control plane of the virtualized computing services. ## Claims ### Claim 1 A computerized system facilitating data set capture management, comprising: a first data store configured at least to maintain a data set; a second data store capable at least of maintaining a plurality of captures of the data set for later inspection, the plurality of captures corresponding to representations of the data set at selected moments in time; a network communicatively coupling at least the first data store and the second data store; a storage policy enforcement component configured to: schedule at least one capture of the data set in accordance with at least one data set capture policy; forecast at least one utilization load of a set of components of the computerized system including the first data store and the network; and schedule at least one pre-capture transfer of at least a portion of the data set prior to said at least one capture; and one or more processors collectively configured at least to facilitate the storage policy enforcement component. ### Claim 2 (depends on 1) The computerized system of claim 1, wherein the storage policy enforcement component is further configured to: forecast at least one pattern of change of the data set based at least in part on at least one historical pattern of change in the data set. ### Claim 3 (depends on 2) The computerized system of claim 2, wherein the storage policy enforcement component is further configured to: select the portion of the data set to transfer in the at least one pre-capture transfer based at least in part on the forecast of the at least one pattern of change of the data set. ### Claim 4 (depends on 2) The computerized system of claim 2, wherein the scheduling of the at least one pre-capture transfer is based at least in part on the forecast of the at least one pattern of change of the data set. ### Claim 5 (depends on 1) The computerized system of claim 1, wherein the at least one pre-capture transfer is scheduled so that a resource utilization benefit of reducing post-capture data transfer exceeds a resource utilization detriment of pre-capture data transfer duplication. ### Claim 6 (depends on 1) The computerized system of claim 1, wherein the storage policy enforcement component configured to schedule at least one capture of the data set in accordance with at least one data set capture policy comprises specifying a window of time during which to perform a capture. ### Claim 7 (depends on 1) The computerized system of claim 1, wherein the storage policy enforcement component configured to schedule at least one capture of the data set in accordance with at least one data set capture policy comprises specifying a target frequency of captures of the data set. ### Claim 8 (depends on 1) The computerized system of claim 1, wherein the storage policy enforcement component configured to at least schedule at least one capture of the data set in accordance with at least one data set capture policy comprises specifying a target probability of loss of at least a portion of the data set from both the first data store and the second data store during a time period. ### Claim 9 A computer-implemented method for facilitating data set capture management, comprising: under control of one or more computer systems configured with executable instructions, causing a first data store to maintain a data set, and causing a second data store to maintain a plurality of captures of the data set for inspection, the plurality of captures corresponding to representations of the data set at moments in time; and maintaining a storage policy enforcement component configured to: schedule at least one capture of a data set in accordance with at least one data set capture policy; forecast at least one utilization load of a set of components including a first data store and a network; and schedule at least one transfer of at least a portion of the data set prior to the at least one capture. ### Claim 10 (depends on 9) The computer-implemented method of claim 9, wherein the storage policy enforcement component is further configured to: forecast at least one pattern of change of the data set based at least in part on at least one historical pattern of change in the data set. ### Claim 11 (depends on 10) The computer-implemented method of claim 10, wherein the storage policy enforcement component is further configured to: select the portion of the data set to transfer in said at least one pre-capture transfer based at least in part on the forecast said at least one pattern of change of the data set. ### Claim 12 (depends on 10) The computer-implemented method of claim 10, wherein the scheduling of the at least one pre-capture transfer is based at least in part on the forecast of the at least one pattern of change of the data set. ### Claim 13 (depends on 9) The computer-implemented method of claim 9, wherein the at least one pre-capture transfer is scheduled so that a resource utilization benefit of reducing post-capture data transfer exceeds a resource utilization detriment of pre-capture data transfer duplication. ### Claim 14 (depends on 9) The computer-implemented method of claim 9, wherein the storage policy enforcement component configured to schedule at least one capture of the data set in accordance with at least one data set capture policy comprises specifying a window of time during which to perform a capture. ### Claim 15 (depends on 9) The computer-implemented method of claim 9, wherein the storage policy enforcement component configured to schedule at least one capture of the data set in accordance with at least one data set capture policy comprises specifying a target frequency of captures of the data set. ### Claim 16 (depends on 9) The computer-implemented method of claim 9, wherein the storage policy enforcement component configured to at least schedule at least one capture of the data set in accordance with at least one data set capture policy comprises specifying a target probability of loss of at least a portion of the data set from both the first data store and the second data store during a time period. ### Claim 17 One or more non-transitory computer-readable media having stored collectively thereon computer executable instructions that configure one or more computers to collectively, at least: cause a first data store to maintain a data set, and causing a second data store to maintain a plurality of captures of the data set for inspection, the plurality of captures corresponding to representations of the data set at moments in time; and maintain a storage policy enforcement component configured to: schedule at least one capture of a data set in accordance with at least one data set capture policy; forecast at least one utilization load of a set of components including a first data store and a network; and schedule at least one transfer of at least a portion of the data set prior to the at least one capture. ### Claim 18 (depends on 17) The one or more non-transitory computer-readable media of claim 17, wherein the storage policy enforcement component is further configured to: forecast at least one pattern of change of the data set based at least in part on at least one historical pattern of change in the data set; and select the portion of the data set to transfer in said at least one pre-capture transfer based at least in part on the forecast said at least one pattern of change of the data set. ### Claim 19 (depends on 17) The one or more non-transitory computer-readable media of claim 17, wherein the scheduling of the at least one pre-capture transfer is arranged to optimize the at least one utilization load of the set of components. ### Claim 20 (depends on 17) The one or more non-transitory computer-readable media of claim 17, wherein the at least one pre-capture transfer is scheduled so that a resource utilization benefit of reducing post-capture data transfer exceeds a resource utilization detriment of pre-capture data transfer duplication.