Detecting data skew in a join operation
AssigneeSnowflake Inc.
InventorsFlorian Andreas Funke, Thierry Cruanes, Benoit Dageville, Marcin Zukowski
Life of this patent
Estimating the term…
Loading patent…
AssigneeSnowflake Inc.
InventorsFlorian Andreas Funke, Thierry Cruanes, Benoit Dageville, Marcin Zukowski
Estimating the term…
Systems, methods, and devices, for managing data skew during a join operation are disclosed. A method includes computing a hash value for a join operation and detecting data skew on a probe side of the join operation at a runtime of the join operation using a lightweight sketch data structure. The method includes identifying a frequent probe-side join key on the probe side of the join operation during a probe phase of the join operation. The method includes identifying a frequent build-side row having a build-side join key corresponding with the frequent probe-side join key. The method includes asynchronously distributing the frequent build-side row to one or more remote servers.
A method comprising:
A local computing system comprising:
A non-transitory computer-readable medium storing instructions that, when executed by one or more local servers, cause the one or more local servers to perform operations comprising:
Dependencies are inferred from the claim text.