# US 12,762,146 B2 · Data retrieval using distributed workers in a large-scale data access system > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,762,146 B2 - Document ID: US12762146B2 - Status: Granted - Kind: B2 - Application number: 18/771,892 - Filed: 2024-07-12 - Published: 2025-01-02 - Granted: 2026-10-13 - Earliest claimed: 2019-09-19 - Assignees: Databricks, Inc. - Applicants: Databricks, Inc. - Inventors: Amandeep Khurana; Nong Li - Web page: https://patentgrep.com/patent/US12762146B2 ## CPC - G06F 16/27: Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor - G06F 9/547: {Remote procedure calls [RPC]; Web services} - G06F 16/2455: Query execution - G06F 16/252: {between a Database Management System and a front-end application} - G06F 16/284: {Relational databases} - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) ## Abstract Disclosed herein provides enhancements for operating a data access application service executing on a data access server system and an external computing system. In the data access server system, a request is received from a client device executing at least one of multiple application services for a dataset from one or more of multiple storage systems. In the data access server system, a data retrieval instruction is generated for the client device to access the dataset from the one or more of the multiple storage systems. The data retrieval instruction comprises task descriptions and a temporary credential. The data retrieval instruction is transferred to the external computing system via the client device and the requested dataset is retrieved and deployed based on the task descriptions and the temporary credential from the one or more of the multiple storage systems. ## Claims ### Claim 1 A method comprising: receiving, at a data access system, a request from a client device to execute a query on data managed at a first storage system and a second storage system that is external from the first storage system, the first storage system and the second storage system being external to the data access system, the data access system maintaining a set of runtime operations for accessing and processing data within the first storage system and the second storage system; generating, based on the set of runtime operations, a first set of data retrieval instructions for accessing and processing a first set of data at the first storage system and a second set of data retrieval instructions for accessing and processing a second set of data at the second storage system; and transmitting the first set of data retrieval instructions and the second set of data retrieval instructions to the client device, the client device transmitting the first set of data retrieval instructions to the first storage system to cause the first storage system to access and process the first set of data at the first storage system, and the client device transmitting the second set of data retrieval instructions to the second storage system to cause the second storage system to access and process the second set of data at the second storage system. ### Claim 2 (depends on 1) The method of claim 1, wherein the first storage system returns a first data result to the client device generated by processing the first set of data and the second storage system returns a second data result to the client device generated by processing the second set of data. ### Claim 3 (depends on 1) The method of claim 1, further comprising: generating a first temporary credential providing limited access to the first set of data stored at the first storage system and a second temporary credential providing limited access to the second set of data stored at the second storage system, the first temporary credential being included in the first set of data retrieval instructions and the second temporary credential being included in the second set of data retrieval instructions. ### Claim 4 (depends on 3) The method of claim 3, wherein the first temporary credential indicates a limited data type from which data is accessible to the client device from the first storage system and the second temporary credential indicates a limited data type from which data is accessible to the client device from the second storage system. ### Claim 5 (depends on 3) The method of claim 3, wherein the first temporary credential indicates a limited duration of time during which data is accessible to the client device from the first storage system and the second temporary credential indicates a limited duration of time during which data is accessible to the client device from the second storage system. ### Claim 6 (depends on 1) The method of claim 1, wherein generating the first set of data retrieval instructions and the second set of data retrieval instructions comprises: accessing a first set of security and authorization restrictions for the first storage system and a second set of security and authorization restrictions for the second storage system; and generating the first set of data retrieval instructions based on the first set of security and authorization restrictions and the second set of data retrieval instructions based on the second set of security and authorization restrictions. ### Claim 7 (depends on 1) The method of claim 1, further comprising: authenticating the request based on authentication information for the first storage system and the second storage system, wherein generating the first set of data retrieval instructions and the second set of data retrieval instructions is performed in response to successfully authentication the request. ### Claim 8 A data access system comprising: one or more computer processors; and one or more computer readable mediums storing instructions that, when executed by the one or more computer processors, cause the data access system to perform operations comprising: receiving a request from a client device to execute a query on data managed at a first storage system and a second storage system that is external from the first storage system, the first storage system and the second storage system being external to the data access system, the data access system maintaining a set of runtime operations for accessing and processing data within the first storage system and the second storage system; generating, based on the set of runtime operations, a first set of data retrieval instructions for accessing and processing a first set of data at the first storage system and a second set of data retrieval instructions for accessing and processing a second set of data at the second storage system; and transmitting the first set of data retrieval instructions and the second set of data retrieval instructions to the client device, the client device transmitting the first set of data retrieval instructions to the first storage system to cause the first storage system to access and process the first set of data at the first storage system, and the client device transmitting the second set of data retrieval instructions to the second storage system to cause the second storage system to access and process the second set of data at the second storage system. ### Claim 9 (depends on 8) The data access system of claim 8, wherein the first storage system returns a first data result to the client device generated by processing the first set of data and the second storage system returns a second data result to the client device generated by processing the second set of data. ### Claim 10 (depends on 8) The data access system of claim 8, the operations further comprising: generating a first temporary credential providing limited access to the first set of data stored at the first storage system and a second temporary credential providing limited access to the second set of data stored at the second storage system, the first temporary credential being included in the first set of data retrieval instructions and the second temporary credential being included in the second set of data retrieval instructions. ### Claim 11 (depends on 10) The data access system of claim 10, wherein the first temporary credential indicates a limited data type from which data is accessible to the client device from the first storage system and the second temporary credential indicates a limited data type from which data is accessible to the client device from the second storage system. ### Claim 12 (depends on 10) The data access system of claim 10, wherein the first temporary credential indicates a limited duration of time during which data is accessible to the client device from the first storage system and the second temporary credential indicates a limited duration of time during which data is accessible to the client device from the second storage system. ### Claim 13 (depends on 8) The data access system of claim 8, wherein generating the first set of data retrieval instructions and the second set of data retrieval instructions comprises: accessing a first set of security and authorization restrictions for the first storage system and a second set of security and authorization restrictions for the second storage system; and generating the first set of data retrieval instructions based on the first set of security and authorization restrictions and the second set of data retrieval instructions based on the second set of security and authorization restrictions. ### Claim 14 (depends on 8) The data access system of claim 8, the operations further comprising: authenticating the request based on authentication information for the first storage system and the second storage system, wherein generating the first set of data retrieval instructions and the second set of data retrieval instructions is performed in response to successfully authentication the request. ### Claim 15 A non-transitory computer-readable medium storing instructions that, when executed by one or more computer processors of a data access system, cause the data access system to perform operations comprising: receiving a request from a client device to execute a query on data managed at a first storage system and a second storage system that is external from the first storage system, the first storage system and the second storage system being external to the data access system, the data access system maintaining a set of runtime operations for accessing and processing data within the first storage system and the second storage system; generating, based on the set of runtime operations, a first set of data retrieval instructions for accessing and processing a first set of data at the first storage system and a second set of data retrieval instructions for accessing and processing a second set of data at the second storage system; and transmitting the first set of data retrieval instructions and the second set of data retrieval instructions to the client device, the client device transmitting the first set of data retrieval instructions to the first storage system to cause the first storage system to access and process the first set of data at the first storage system, and the client device transmitting the second set of data retrieval instructions to the second storage system to cause the second storage system to access and process the second set of data at the second storage system. ### Claim 16 (depends on 15) The non-transitory computer-readable medium of claim 15, wherein the first storage system returns a first data result to the client device generated by processing the first set of data and the second storage system returns a second data result to the client device generated by processing the second set of data. ### Claim 17 (depends on 15) The non-transitory computer-readable medium of claim 15, the operations further comprising: generating a first temporary credential providing limited access to the first set of data stored at the first storage system and a second temporary credential providing limited access to the second set of data stored at the second storage system, the first temporary credential being included in the first set of data retrieval instructions and the second temporary credential being included in the second set of data retrieval instructions. ### Claim 18 (depends on 17) The non-transitory computer-readable medium of claim 17, wherein the first temporary credential indicates a limited data type from which data is accessible to the client device from the first storage system and the second temporary credential indicates a limited data type from which data is accessible to the client device from the second storage system. ### Claim 19 (depends on 17) The non-transitory computer-readable medium of claim 17, wherein the first temporary credential indicates a limited duration of time during which data is accessible to the client device from the first storage system and the second temporary credential indicates a limited duration of time during which data is accessible to the client device from the second storage system. ### Claim 20 (depends on 15) The non-transitory computer-readable medium of claim 15, wherein generating the first set of data retrieval instructions and the second set of data retrieval instructions comprises: accessing a first set of security and authorization restrictions for the first storage system and a second set of security and authorization restrictions for the second storage system; and generating the first set of data retrieval instructions based on the first set of security and authorization restrictions and the second set of data retrieval instructions based on the second set of security and authorization restrictions.