# US 2022/0036129 A1 · Method, device, and computer program product for model updating

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0036129 A1
- Document ID: US20220036129A1
- Status: Published application
- Kind: A1
- Application number: 17/003,573
- Filed: 2020-08-26
- Published: 2022-02-03
- Earliest claimed: 2020-07-31
- Assignees: EMC IP Holding Company LLC
- Applicants: EMC IP Holding Company LLC
- Inventors: Jiacheng Ni; Jinpeng Liu; Qiang Chen; Zijia Wang; Zhen Jia
- Web page: https://patentgrep.com/patent/US20220036129A1

## CPC

- G06F 18/214: Generating training patterns; Bootstrap methods, e.g. bagging or boosting
- G06V 10/776: Validation; Performance evaluation
- G06F 18/2185: {the supervisor being an automated module, e.g. intelligent oracle}
- G06V 10/774: Generating sets of training patterns; Bootstrap methods, e.g. bagging or boosting
- G06V 10/82: using neural networks
- G06V 20/20: in augmented reality scenes
- G06V 40/161: {Detection; Localisation; Normalisation}
- G06V 40/168: {Feature extraction; Face representation}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

The present disclosure relates to a method, a device, and a computer program product for model updating. The method includes: acquiring a first image set and first annotation information, wherein the first annotation information indicates whether a corresponding image in the first image set includes a target object; updating a first version of an object verification model using the first image set and the first annotation information to obtain a second version, wherein the first version of the object verification model has been deployed to determine whether an input image includes the target object; determining the accuracy of the second version of the object verification model; and updating, if it is determined that the accuracy is lower than a preset accuracy threshold, the second version of the object verification model using a second image set and second annotation information to obtain a third version of the object verification model.

## Claims

### Claim 1

A model updating method, comprising:
acquiring a first image set and first annotation information, wherein the first annotation information indicates whether a corresponding image in the first image set includes a target object;
updating a first version of an object verification model using the first image set and the first annotation information to obtain a second version of the object verification model, wherein the first version of the object verification model has been deployed to determine whether an input image includes the target object;
determining the accuracy of the second version of the object verification model; and
updating, if it is determined that the accuracy is lower than a preset accuracy threshold, the second version of the object verification model using a second image set and second annotation information to obtain a third version of the object verification model, wherein the number of images in the second image set is greater than the number of images in the first image set, and the second annotation information indicates whether a corresponding image in the second image set includes a desired object.

### Claim 2 (depends on 1)

The method according to claim 1, wherein acquiring the first image set and the first annotation information comprises:
acquiring at least one input image collected in the use of the first version of the object verification model and a verification result corresponding to the at least one image, wherein the verification result indicates whether the at least one image includes the target object;
including the at least one input image into the first image set; and
determining the first annotation information based on the verification result.

### Claim 3 (depends on 2)

The method according to claim 2, wherein acquiring the at least one input image comprises acquiring at least one of the following:
a first input image that is determined by the object verification model to include the target object, wherein the first annotation information is determined to indicate that the first input image includes the target object,
a second input image that is determined by the object verification model to not include the target object, wherein the verification result of the object verification model is used to determine a permission, an object in the second input image is determined to have the permission, and the first annotation information is determined to indicate that the second input image includes the target object, and
a third input image that is determined by the object verification model to not include the target object, wherein an object in the third input image is determined to not have the permission, and the first annotation information is determined to indicate that the second input image does not include the target object,
a reference image that is provided for verification by the object verification model, wherein the first annotation information is determined to indicate that the reference image includes the target object.

### Claim 4 (depends on 1)

The method according to claim 1, wherein updating the first version of the object verification model comprises:
training the first version of the object verification model using the first image set and the first annotation information to meet a first convergence condition of a first objective function; and
wherein updating the second version of the object verification model comprises:
training the second version of the object verification model using the second image set and the second annotation information to meet a second convergence condition of a second objective function, wherein the complexity of meeting the second convergence condition is greater than the complexity of meeting the first convergence condition.

### Claim 5 (depends on 1)

The method according to claim 1, wherein updating the first version of the object verification model comprises:
updating the first version of the object verification model using training that is based on mini-batch stochastic gradient descent.

### Claim 6 (depends on 1)

The method according to claim 1, wherein updating the first version of the object verification model comprises:
training the first version of the object verification model based on a preset learning rate using the first image set and the first annotation information, wherein the preset learning rate is less than a preset threshold.

### Claim 7 (depends on 1)

The method according to claim 1, wherein the target object comprises a target face.

### Claim 8

An electronic device, comprising:
at least one processor; and
at least one memory storing computer program instructions, wherein the at least one memory and the computer program instructions are configured to cause, together with the at least one processor, the electronic device to perform actions including:
acquiring a first image set and first annotation information, wherein the first annotation information indicates whether a corresponding image in the first image set includes a target object;
updating a first version of an object verification model using the first image set and the first annotation information to obtain a second version of the object verification model, wherein the first version of the object verification model has been deployed to determine whether an input image includes the target object;
determining the accuracy of the second version of the object verification model; and
updating, if it is determined that the accuracy is lower than a preset accuracy threshold, the second version of the object verification model using a second image set and second annotation information to obtain a third version of the object verification model, wherein the number of images in the second image set is greater than the number of images in the first image set, and the second annotation information indicates whether a corresponding image in the second image set includes a desired object.

### Claim 9 (depends on 8)

The device according to claim 8, wherein acquiring the first image set and the first annotation information includes:
acquiring at least one input image collected in the use of the first version of the object verification model and a verification result corresponding to the at least one image, wherein the verification result indicates whether the at least one image includes the target object;
including the at least one input image into the first image set; and
determining the first annotation information based on the verification result.

### Claim 10 (depends on 9)

The device according to claim 9, wherein acquiring the at least one input image comprises acquiring at least one of the following:
a first input image that is determined by the object verification model to include the target object, wherein the first annotation information is determined to indicate that the first input image includes the target object,
a second input image that is determined by the object verification model to not include the target object, wherein the verification result of the object verification model is used to determine a permission, an object in the second input image is determined to have the permission, and the first annotation information is determined to indicate that the second input image includes the target object, and
a third input image that is determined by the object verification model to not include the target object, wherein an object in the third input image is determined to not have the permission, and the first annotation information is determined to indicate that the second input image does not include the target object,
a reference image that is provided for verification by the object verification model, wherein the first annotation information is determined to indicate that the reference image includes the target object.

### Claim 11 (depends on 8)

The device according to claim 8, wherein updating the first version of the object verification model comprises:
training the first version of the object verification model using the first image set and the first annotation information to meet a first convergence condition of a first objective function; and
wherein updating the second version of the object verification model comprises:
training the second version of the object verification model using the second image set and the second annotation information to meet a second convergence condition of a second objective function, wherein the complexity of meeting the second convergence condition is greater than the complexity of meeting the first convergence condition.

### Claim 12 (depends on 8)

The device according to claim 8, wherein updating the first version of the object verification model comprises:
updating the first version of the object verification model using training that is based on mini-batch stochastic gradient descent.

### Claim 13 (depends on 8)

The device according to claim 8, wherein updating the first version of the object verification model comprises:
training the first version of the object verification model based on a preset learning rate using the first image set and the first annotation information, wherein the preset learning rate is less than a preset threshold.

### Claim 14 (depends on 8)

The device according to claim 8, wherein the target object comprises a target face.

### Claim 15

A computer program product tangibly stored on a non-volatile computer-readable medium and comprising computer-executable instructions, wherein the computer-executable instructions, when executed, cause a device to perform actions comprising:
acquiring a first image set and first annotation information, wherein the first annotation information indicates whether a corresponding image in the first image set includes a target object;
updating a first version of an object verification model using the first image set and the first annotation information to obtain a second version of the object verification model, wherein the first version of the object verification model has been deployed to determine whether an input image includes the target object;
determining the accuracy of the second version of the object verification model; and
updating, if it is determined that the accuracy is lower than a preset accuracy threshold, the second version of the object verification model using a second image set and second annotation information to obtain a third version of the object verification model, wherein the number of images in the second image set is greater than the number of images in the first image set, and the second annotation information indicates whether a corresponding image in the second image set includes a desired object.

### Claim 16 (depends on 15)

The computer program product according to claim 15, wherein acquiring the first image set and the first annotation information comprises:
acquiring at least one input image collected in the use of the first version of the object verification model and a verification result corresponding to the at least one image, wherein the verification result indicates whether the at least one image includes the target object;
including the at least one input image into the first image set; and
determining the first annotation information based on the verification result.

### Claim 17 (depends on 16)

The computer program product according to claim 16, wherein acquiring the at least one input image comprises acquiring at least one of the following:
a first input image that is determined by the object verification model to include the target object, wherein the first annotation information is determined to indicate that the first input image includes the target object,
a second input image that is determined by the object verification model to not include the target object, wherein the verification result of the object verification model is used to determine a permission, an object in the second input image is determined to have the permission, and the first annotation information is determined to indicate that the second input image includes the target object, and
a third input image that is determined by the object verification model to not include the target object, wherein an object in the third input image is determined to not have the permission, and the first annotation information is determined to indicate that the second input image does not include the target object,
a reference image that is provided for verification by the object verification model, wherein the first annotation information is determined to indicate that the reference image includes the target object.

### Claim 18 (depends on 15)

The computer program product according to claim 15, wherein updating the first version of the object verification model comprises:
training the first version of the object verification model using the first image set and the first annotation information to meet a first convergence condition of a first objective function; and
wherein updating the second version of the object verification model comprises:
training the second version of the object verification model using the second image set and the second annotation information to meet a second convergence condition of a second objective function, wherein the complexity of meeting the second convergence condition is greater than the complexity of meeting the first convergence condition.

### Claim 19 (depends on 15)

The computer program product according to claim 15, wherein updating the first version of the object verification model comprises:
updating the first version of the object verification model using training that is based on mini-batch stochastic gradient descent.

### Claim 20 (depends on 15)

The computer program product according to claim 15, wherein updating the first version of the object verification model comprises:
training the first version of the object verification model based on a preset learning rate using the first image set and the first annotation information, wherein the preset learning rate is less than a preset threshold.
