Capturing data lake changes
Assigneesalesforce.com, inc.
InventorsShreedhar Sundaram, Mahalaxmi Sanathkumar, Aaron Zhang, Parin Kenia, Violet Gong, Priya Sethuraman, Zhidong Ke, Kevin Terusak
Life of this patent
Estimating the term…
Abstract
A request may be received to transform records in a data lake that match one or more query criteria. Data lake records that match the criteria may be retrieved. The retrieved records may include two data lake records associated with the same data lake record identifier. A transformed record may be generated based on time stamps associated with the retrieved records.
Claims20
A computer-implemented method comprising:
- receiving a request to transform records in a data lake that match one or more query criteria;
- retrieving from the data lake a plurality of data lake records that match the one or more query criteria, the plurality of data lake records including a first data lake record and a second data lake record, the first data lake record being associated with a designated data lake record identifier and a first timestamp identifying when the first data lake record was created, the second data lake record being associated with the designated data lake record identifier and a second timestamp identifying when the second data lake record was created;
- based on a comparison of the first timestamp to the second timestamp, generating a transformed data lake record based on the first data lake record;
- and
- transmitting the transformed data lake record to a downstream data service.
A computing system implemented in a cloud computing environment, the computing system configured to perform a method comprising:
- receiving a request to transform records in a data lake that match one or more query criteria;
- retrieving from the data lake a plurality of data lake records that match the one or more query criteria, the plurality of data lake records including a first data lake record and a second data lake record, the first data lake record being associated with a designated data lake record identifier and a first timestamp identifying when the first data lake record was created, the second data lake record being associated with the designated data lake record identifier and a second timestamp identifying when the second data lake record was created;
- based on a comparison of the first timestamp to the second timestamp, generating a transformed data lake record based on the first data lake record;
- and
- transmitting the transformed data lake record to a downstream data service.
One or more non-transitory machine-readable media having instructions stored thereon for performing a method, the method comprising:
- receiving a request to transform records in a data lake that match one or more query criteria;
- retrieving from the data lake a plurality of data lake records that match the one or more query criteria, the plurality of data lake records including a first data lake record and a second data lake record, the first data lake record being associated with a designated data lake record identifier and a first timestamp identifying when the first data lake record was created, the second data lake record being associated with the designated data lake record identifier and a second timestamp identifying when the second data lake record was created;
- based on a comparison of the first timestamp to the second timestamp, generating a transformed data lake record based on the first data lake record;
- and
- transmitting the transformed data lake record to a downstream data service.
Dependencies are inferred from the claim text.