# US 2025/0156469 A1 · Lakehouse metadata change determination method, device, and medium

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0156469 A1
- Document ID: US20250156469A1
- Status: Published application
- Kind: A1
- Application number: 18/934,470
- Filed: 2024-11-01
- Published: 2025-05-15
- Earliest claimed: 2023-11-09
- Assignees: Beijing Volcano Engine Technology Co., Ltd.
- Applicants: Beijing Volcano Engine Technology Co., Ltd.
- Inventors: Mengjun LI; Jun GUO; Ke SUN; Qing XU
- Web page: https://patentgrep.com/patent/US20250156469A1

## CPC

- G06F 16/383: using metadata automatically derived from the content
- G06F 16/2358: {Change logging, detection, and notification (replication G06F16/27)}
- G06F 16/2365: {Ensuring data consistency and integrity}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

The present disclosure discloses a lakehouse metadata change determination method, an electronic device, and a computer-readable medium. The method includes: for a metadata storage system, after receiving a metadata processing request sent by a data engine and used for requesting to perform update processing on a target object, executing object update processing logic corresponding to the metadata processing request, and after it is determined that the object update processing logic is completed, generating an update description message corresponding to the target object according to a comparison result between the target object before updating and the target object after updating, so that the update description message indicates that the update processing on the target object has been performed, and the update description message can be subsequently sent to a message receiving object.

## Claims

### Claim 1

A lakehouse metadata change determination method, which is applied to a metadata storage system, the method comprising:
receiving a metadata processing request sent by a data engine, the metadata processing request is used for requesting to perform update processing on a target object, and the target object comprises one or a plurality of metadata;
executing object update processing logic corresponding to the metadata processing request, the object update processing logic is used for updating the target object;
after it is determined that the object update processing logic is completed, generating an update description message corresponding to the target object according to a comparison result between the target object before updating and the target object after updating; and
sending the update description message to a message receiving object.

### Claim 2 (depends on 1)

The method according to claim 1, wherein a process of generating the update description message comprises:
if the comparison result indicates that an object identifier of the target object before updating is different from an object identifier of the target object after updating, generating the update description message according to a type of the target object.

### Claim 3 (depends on 2)

The method according to claim 2, wherein if the target object is a table object, the generating the update description message according to a type of the target object comprises:
if the type of the target object is a table type, generating the update description message according to a first preset string, semantic information expressed by the first preset string is updating of an object identifier of the table object that belongs to the table type; or
if the type of the target object is a view type, generating the update description message according to a second preset string, semantic information expressed by the second preset string is updating of an object identifier of the table object that belongs to the view type.

### Claim 4 (depends on 1)

The method according to claim 1, wherein the target object is used for recording a plurality metadata; and
a process of generating the update description message comprises:
if the comparison result indicates that a number of data blocks obtained by dividing the target object before updating in a target dimension is the same as a number of data blocks obtained by dividing the target object after updating in the target dimension, and there is a difference in at least one data block between the target object before updating and the target object after updating, generating the update description message according to a number of the at least one data block.

### Claim 5 (depends on 4)

The method according to claim 4, wherein the generating the update description message according to a number of the at least one data block comprises:
if the number of the at least one data block is 1, generating the update description message according to a third preset string, semantic information expressed by the third preset string is updating one data block; or
if the number of the at least one data block is not less than 2, generating the update description message according to a fourth preset string, semantic information expressed by the fourth preset string is updating a plurality of data blocks.

### Claim 6 (depends on 1)

The method according to claim 1, wherein the target object is used for recording a plurality of metadata; and
a process of generating the update description message comprises at least one of the following:
if the comparison result indicates that a number of data blocks obtained by dividing the target object after updating in a target dimension is greater than a number of data blocks obtained by dividing the target object before updating in the target dimension, and the data blocks obtained by dividing the target object after updating in the target dimension comprise the data blocks obtained by dividing the target object before updating in the target dimension, generating the update description message according to a fifth preset string, semantic information expressed by the fifth preset string is adding the data block;
if the comparison result indicates that the number of data blocks obtained by dividing the target object before updating in the target dimension is greater than the number of data blocks obtained by dividing the target object after updating in the target dimension, and the data blocks obtained by dividing the target object before updating in the target dimension comprise the data blocks obtained by dividing the target object after updating in the target dimension, generating the update description message according to a sixth preset string, semantic information expressed by the sixth preset string is deleting the data block; or
if the comparison result indicates that the number of data blocks obtained by dividing the target object before updating in the target dimension is different from the number of data blocks obtained by dividing the target object after updating in the target dimension, and there is a difference in at least one data block between the target object before updating and the target object after updating, generating the update description message according to a fourth preset string, semantic information expressed by the fourth preset string is updating a plurality of data blocks.

### Claim 7 (depends on 4)

The method according to claim 4, wherein the target object is a database object, a table object, or a partition object.

### Claim 8 (depends on 1)

The method according to claim 1, wherein the message receiving object is a message middleware or at least one downstream object corresponding to the data engine, and the message middleware is configured to provide the update description message to each downstream object.

### Claim 9 (depends on 1)

The method according to claim 1, wherein the generating an update description message corresponding to the target object according to a comparison result between the target object before updating and the target object after updating comprises:
generating the update description message corresponding to the target object according to a preset message format and the comparison result between the target object before updating and the target object after updating, the preset message format is a message format used when the data engine sends a message to the message receiving object.

### Claim 10 (depends on 1)

The method according to claim 1, wherein the message receiving object is further configured to receive an object update message generated by the data engine for the metadata processing request; and
semantic information carried in the object update message is partially or completely consistent with semantic information carried in the update description message.

### Claim 11 (depends on 1)

The method according to claim 1, wherein the metadata processing request is used to describe a plurality of update processing tasks;
the executing object update processing logic corresponding to the metadata processing request comprises:
executing object update processing logic corresponding to each update processing task; and
a process of generating the update description message corresponding to the target object comprises:
for any update processing task, after it is determined that the object update processing logic corresponding to the update processing task has been executed, generating an update description message corresponding to the update processing task according to a comparison result between the target object before updating corresponding to the update processing task and the target object after updating corresponding to the update processing task; and
generating the update description message corresponding to the target object according to update description messages corresponding to the plurality of update processing tasks.

### Claim 12 (depends on 1)

The method according to claim 1, wherein the metadata processing request is generated by the data engine in response to an object update request sent by a client, and the object update request carries client description information; and
the generating an update description message corresponding to the target object according to a comparison result between the target object before updating and the target object after updating comprises:
generating the update description message corresponding to the target object according to the client description information provided by the data engine and the comparison result between the target object before updating and the target object after updating.

### Claim 13 (depends on 12)

The method according to claim 12, wherein the generating the update description message corresponding to the target object according to the client description information provided by the data engine and the comparison result between the target object before updating and the target object after updating comprises:
generating the update description message corresponding to the target object according to the client description information carried in the metadata processing request and the comparison result between the target object before updating and the target object after updating.

### Claim 14 (depends on 12)

The method according to claim 12, wherein before the receiving a metadata processing request sent by a data engine, the method further comprises:
receiving client description information sent by the data engine; and
the receiving a metadata processing request sent by a data engine comprises:
receiving the metadata processing request corresponding to the client description information that is sent by the data engine.

### Claim 15 (depends on 1)

The method according to claim 1, wherein the after it is determined that the object update processing logic is completed, generating an update description message corresponding to the target object according to a comparison result between the target object before updating and the target object after updating comprises:
after it is determined that the object update processing logic is completed, obtaining logic execution result description information corresponding to the metadata processing request, wherein the logic execution result description information comprises a part of or all information carried in the metadata processing request, the part of or all information comprises object description information of the target object before updating and object description information of the target object after updating, and
sending the logic execution result description information to a message generation module embedded in the metadata storage system, so that the message generation module obtains the target object before updating and the target object after updating according to the logic execution result description information, and generates the update description message corresponding to the target object according to the comparison result between the target object before updating and the target object after updating.

### Claim 16 (depends on 1)

An electronic device, comprising a processor and a memory;
the memory is configured to store an instruction or a computer program; and
the processor is configured to execute the instruction or the computer program in the memory, so that the electronic device performs the method according to claim 1.

### Claim 17 (depends on 1)

A computer-readable medium, the computer-readable medium stores an instruction or a computer program, and when the instruction or the computer program runs on a device, the device performs the method according to claim 1.

### Claim 18 (depends on 16)

The electronic device according to claim 16, wherein a process of generating the update description message comprises:
if the comparison result indicates that an object identifier of the target object before updating is different from an object identifier of the target object after updating, generating the update description message according to a type of the target object.

### Claim 19 (depends on 16)

The electronic device according to claim 16, wherein the target object is used for recording a plurality metadata; and
a process of generating the update description message comprises:
if the comparison result indicates that a number of data blocks obtained by dividing the target object before updating in a target dimension is the same as a number of data blocks obtained by dividing the target object after updating in the target dimension, and there is a difference in at least one data block between the target object before updating and the target object after updating, generating the update description message according to a number of the at least one data block.

### Claim 20 (depends on 16)

The electronic device according to claim 16, wherein the target object is used for recording a plurality of metadata; and
a process of generating the update description message comprises at least one of the following:
if the comparison result indicates that a number of data blocks obtained by dividing the target object after updating in a target dimension is greater than a number of data blocks obtained by dividing the target object before updating in the target dimension, and the data blocks obtained by dividing the target object after updating in the target dimension comprise the data blocks obtained by dividing the target object before updating in the target dimension, generating the update description message according to a fifth preset string, semantic information expressed by the fifth preset string is adding the data block;
if the comparison result indicates that the number of data blocks obtained by dividing the target object before updating in the target dimension is greater than the number of data blocks obtained by dividing the target object after updating in the target dimension, and the data blocks obtained by dividing the target object before updating in the target dimension comprise the data blocks obtained by dividing the target object after updating in the target dimension, generating the update description message according to a sixth preset string, semantic information expressed by the sixth preset string is deleting the data block; or
if the comparison result indicates that the number of data blocks obtained by dividing the target object before updating in the target dimension is different from the number of data blocks obtained by dividing the target object after updating in the target dimension, and there is a difference in at least one data block between the target object before updating and the target object after updating, generating the update description message according to a fourth preset string, semantic information expressed by the fourth preset string is updating a plurality of data blocks.
