US 2023/0418968 A1 · EVIDENCE DATA COLLECTOR USING CONTENT ADDRESSABLE STORAGE

Abstract

Techniques for implementing an evidence data collector (EDC) service using content addressable storage are provided. At a high level, the EDC service can receive a request for data (referred to herein as an evidence query) regarding an activity, component, or artifact of the data processing pipeline, process the evidence query by collecting the data from one or more data sources associated with the pipeline, and return a response (referred to herein as an evidence claim) that includes a reference to the collected data. In certain embodiments, the EDC service can maintain the collected data for each evidence query (or a digest of that data) in a content addressable storage system, which enables observers/verifiers to detect and remediate man-in-the-middle attacks on the EDC service.

Claims21

Dependent claims

A method comprising:

receiving, by a computer system implementing an evidence data collector (EDC) service, an evidence query from a client, the evidence query corresponding to a request for data pertaining to operation of a data processing pipeline;
storing, by the computer system, the evidence query as a query document in a content addressable storage system, the storing of the evidence query resulting in a first content identifier (CID) that uniquely identifies content of the query document;
collecting, by the computer system, data responsive to the evidence query from one or more data sources associated with the data processing pipeline;
storing, by the computer system, the collected data in a result document in the content addressable storage system, the storing of the collected data resulting in a second CID that uniquely identifies content of the result document;
storing, by the computer system, an association between the first CID and the second CID in an association document in the content addressable storage system;
and
returning, by the computer system, the second CID to the client.

4 more elements

A computer system implementing an evidence data collector (EDC) service, the computer system comprising:

a processor;
a content addressable storage system;
and
a non-transitory computer readable medium having stored thereon program code that, when executed, causes the processor to:
receive an evidence query from a client, the evidence query corresponding to a request for data pertaining to operation of a data processing pipeline;
store the evidence query as a query document in the content addressable storage system, the storing of the evidence query resulting in a first content identifier (CID) that uniquely identifies content of the query document;
collect data responsive to the evidence query from one or more data sources associated with the data processing pipeline;
store the collected data in a result document in the content addressable storage system, the storing of the collected data resulting in a second CID that uniquely identifies content of the result document;
store an association between the first CID and the second CID in an association document in the content addressable storage system;
and
return the second CID to the client.

8 more elements

Dependencies are inferred from the claim text.

Evidence data collector using content addressable storage

Life of this patent

Evidence data collector using content addressable storage

Life of this patent

Abstract

Claims21