# US 12,182,130 B2 · Optimized processing of data in different formats > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,182,130 B2 - Document ID: US12182130B2 - Status: Granted - Kind: B2 - Application number: 18/324,710 - Filed: 2023-05-26 - Published: 2023-09-21 - Granted: 2024-12-31 - Earliest claimed: 2021-04-09 - Assignees: Snowflake Inc. - Applicants: Snowflake Inc. - Inventors: Tyler Arthur Akidau; Thierry Cruanes; Istvan Cseri; Benoit Dageville; Tyler Jones; Dinesh Chandrakant Kulkarni - Web page: https://patentgrep.com/patent/US12182130B2 ## CPC - G06F 16/24568: {Data stream processing; Continuous queries} - G06F 16/24544: {Join order optimisation} - G06F 16/25: Integrating or interfacing systems involving database management systems - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) ## Abstract Hybrid tables can be used in different use-case scenarios. Hybrid tables provide a flexible mechanism to support files and data in different formats while providing access to the different types of data as part of one table. This flexibility can allow the use of hybrid tables in data lake or other similar environments. ## Claims ### Claim 1 A method comprising: storing a first set of data in a first format for a hybrid table in a first cloud storage location; storing a second set of data in a second format for the hybrid table in a second cloud storage location; storing a copy of a first subset of the first set of data in the second cloud storage location in the second format, wherein the first subset of the first set of data in the first format is maintained in the first cloud storage location; providing an interface for accessing the first set of data and the second set of data; receiving, via the interface, a query referencing the first set of data and the second set of data; determining that the query references a second set subset of the first set of data not copied in the second storage location; converting the second subset of the first set of data from the first format into a common format; joining the second subset of data referenced in the query and the second subset of the first set of data in the common format; executing the query based on the joined data; classifying the first subset of the first set of data as low-value data; in response to classifying the first subset of the first set of data as low-value data, deleting the copy of the first subset of the first set of data in the second cloud storage location in the second format; and updating metadata of the hybrid table based on deleting the copy of the first subset of the first set of data. ### Claim 2 (depends on 1) The method of claim 1, wherein the first cloud storage location is in an external cloud storage location and wherein the second cloud storage location is a network-based data warehouse system, wherein the first format is a raw format and the second format is a formatted format used by the network-based data warehouse system. ### Claim 3 (depends on 1) The method of claim 1, wherein the first subset of the first set data was previously classified as high-value data and the copy of the first subset of the first set of data was ingested from the first cloud storage location into the second cloud storage location in the second format, wherein the first subset of the first set of data in the first format was maintained in the first cloud storage location and not deleted in the first cloud storage location. ### Claim 4 (depends on 1) The method of claim 1, wherein the classifying is performed based on query patterns. ### Claim 5 (depends on 1) The method of claim 1, wherein the classifying is performed based on scan statistics. ### Claim 6 (depends on 1) The method of claim 1, wherein the classifying is performed based on metadata received from a client. ### Claim 7 A machine-storage medium embodying instructions that, when executed by a machine, cause the machine to perform operations comprising: storing a first set of data in a first format for a hybrid table in a first cloud storage location; storing a second set of data in a second format for the hybrid table in a second cloud storage location; storing a copy of a first subset of the first set of data in the second cloud storage location in the second format, wherein the first subset of the first set of data in the first format is maintained in the first cloud storage location; providing an interface for accessing the first set of data and the second set of data; receiving, via the interface, a query referencing the first set of data and the second set of data; determining that the query references a second set subset of the first set of data not copied in the second storage location; converting the second subset of the first set of data from the first format into a common format; joining the second subset of data referenced in the query and the second subset of the first set of data in the common format; executing the query based on the joined data; classifying the first subset of the first set of data as low-value data; in response to classifying the first subset of the first set of data as low-value data, deleting the copy of the first subset of the first set of data in the second cloud storage location in the second format; and updating metadata of the hybrid table based on deleting the copy of the first subset of the first set of data. ### Claim 8 (depends on 7) The machine-storage medium of claim 7, wherein the first cloud storage location is in an external cloud storage location and wherein the second cloud storage location is a network-based data warehouse system, wherein the first format is a raw format and the second format is a formatted format used by the network-based data warehouse system. ### Claim 9 (depends on 7) The machine-storage medium of claim 7, wherein the first subset of the first set data was previously classified as high-value data and the copy of the first subset of the first set of data was ingested from the first cloud storage location into the second cloud storage location in the second format, wherein the first subset of the first set of data in the first format was maintained in the first cloud storage location and not deleted in the first cloud storage location. ### Claim 10 (depends on 7) The machine-storage medium of claim 7, wherein the classifying is performed based on query patterns. ### Claim 11 (depends on 7) The machine-storage medium of claim 7, wherein the classifying is performed based on scan statistics. ### Claim 12 (depends on 7) The machine-storage medium of claim 7, wherein the classifying is performed based on metadata received from a client. ### Claim 13 A system comprising: at least one hardware processor; and at least one memory storing instructions that, when executed by the at least one hardware processor, cause the at least one hardware processor to perform operations comprising: storing a first set of data in a first format for a hybrid table in a first cloud storage location; storing a second set of data in a second format for the hybrid table in a second cloud storage location; storing a copy of a first subset of the first set of data in the second cloud storage location in the second format, wherein the first subset of the first set of data in the first format is maintained in the first cloud storage location; providing an interface for accessing the first set of data and the second set of data; receiving, via the interface, a query referencing the first set of data and the second set of data; determining that the query references a second set subset of the first set of data not copied in the second storage location; converting the second subset of the first set of data from the first format into a common format; joining the second subset of data referenced in the query and the second subset of the first set of data in the common format; executing the query based on the joined data; classifying the first subset of the first set of data as low-value data; in response to classifying the first subset of the first set of data as low-value data, deleting the copy of the first subset of the first set of data in the second cloud storage location in the second format; and updating metadata of the hybrid table based on deleting the copy of the first subset of the first set of data. ### Claim 14 (depends on 13) The system of claim 13, wherein the first cloud storage location is in an external cloud storage location and wherein the second cloud storage location is a network-based data warehouse system, wherein the first format is a raw format and the second format is a formatted format used by the network-based data warehouse system. ### Claim 15 (depends on 13) The system of claim 13, wherein the first subset of the first set data was previously classified as high-value data and the copy of the first subset of the first set of data was ingested from the first cloud storage location into the second cloud storage location in the second format, wherein the first subset of the first set of data in the first format was maintained in the first cloud storage location and not deleted in the first cloud storage location. ### Claim 16 (depends on 13) The system of claim 13, wherein the classifying is performed based on query patterns. ### Claim 17 (depends on 13) The system of claim 13, wherein the classifying is performed based on scan statistics. ### Claim 18 (depends on 13) The system of claim 13, wherein the classifying is performed based on metadata received from a client.