Systems, methods, and devices for managing data skew in a join operation
AssigneeSnowflake Inc.
InventorsFlorian Andreas Funke, Thierry Cruanes, Benoit Dageville, Marcin Zukowski
Life of this patent
Estimating the term…
Loading patent…
AssigneeSnowflake Inc.
InventorsFlorian Andreas Funke, Thierry Cruanes, Benoit Dageville, Marcin Zukowski
Estimating the term…
Systems, methods, and devices, for managing data skew during a join operation are disclosed. A method includes computing a hash value for a join operation and detecting data skew on a probe side of the join operation at a runtime of the join operation using a lightweight sketch data structure. The method includes identifying a frequent probe-side join key on the probe side of the join operation during a probe phase of the join operation. The method includes identifying a frequent build-side row having a build-side join key corresponding with the frequent probe-side join key. The method includes asynchronously distributing the frequent build-side row to one or more remote servers.
A method comprising:
A first server comprising:
One or more non-transitory computer-readable storage media containing instructions that, when executed by at least one hardware processor of a first server, cause the at least one hardware processor to perform operations comprising:
Dependencies are inferred from the claim text.