Accelerating change data capture determination using row bitsets preliminary

A machine-storage medium embodying instructions that, when executed by a machine, cause the machine to perform actions comprising:

• generating a plurality of row bitsets for a plurality of micro-partitions in a table involved in one or more operations, the plurality of row bitsets including one inserted row bitset with a first single bit for marking newly inserted and new versions of updated rows, one deleted row bitset with a second single bit for marking newly deleted rows, one updated row bitset with a third single bit for marking previous versions of updated rows, the deleted and updated row bitsets being generated in a scanback row set operator (RSO) during one or more update, delete, or merge operations, and the inserted row bitsets being generated in an insert RSO during one or more insert, update, merge, or copy operations;
• scanning a subset of rows in the table based on the plurality of row bitsets, the subset of rows marked as being modified by the row bitsets;
• and
• generating change data capture information showing changes made to the table in a specified time interval based on the scanned subset of rows.

A system comprising:

• at least one hardware processor;
• and
• at least one memory storing instructions that, when executed by the at least one hardware processor, cause the at least one hardware processor to perform actions comprising:
• generating a plurality of row bitsets for a plurality of micro-partitions in a table involved in one or more operations, the plurality of row bitsets including one inserted row bitset with a first single bit for marking newly inserted and new versions of updated rows, one deleted row bitset with a second single bit for marking newly deleted rows, one updated row bitset with a third single bit for marking previous versions of updated rows, the deleted and updated row bitsets being generated in a scanback row set operator (RSO) during one or more update, delete, or merge operations, and the inserted row bitsets being generated in an insert RSO during one or more insert, update, merge, or copy operations;
• scanning a subset of rows in the table based on the plurality of row bitsets, the subset of rows marked as being modified by the row bitsets;
• and
• generating change data capture information showing changes made to the table in a specified time interval based on the scanned subset of rows.