# US 2022/0044438 A1 · Object detection model generation method and electronic device and computer readable storage medium using the same

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0044438 A1
- Document ID: US20220044438A1
- Status: Published application
- Kind: A1
- Application number: 17/403,902
- Filed: 2021-08-17
- Published: 2022-02-10
- Earliest claimed: 2020-08-05
- Assignees: Ubtech Robotics Corp Ltd
- Applicants: Ubtech Robotics Corp Ltd
- Inventors: Yepeng Liu; Yusheng Zeng; Jun Cheng; Jing Gu; Yue Wang; Jianxin Pang
- Web page: https://patentgrep.com/patent/US20220044438A1

## CPC

- G06T 7/74: {involving reference images or patches}
- G06V 40/161: {Detection; Localisation; Normalisation}
- G06N 3/04: Architecture, e.g. interconnection topology
- G06N 3/0455: Auto-encoder networks; Encoder-decoder networks
- G06N 3/0464: Convolutional networks [CNN, ConvNet]
- G06N 3/08: Learning methods
- G06N 3/09: Supervised learning
- G06T 7/75: {involving models}
- G06V 10/764: using classification, e.g. of video objects
- G06V 40/164: {using holistic features}
- G06N 3/045: Combinations of networks
- G06T 2207/20081: Training; Learning
- G06T 2207/20084: Artificial neural networks [ANN]
- G06T 2207/30201: Face
- Y02T 10/40: Engine management systems
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- Y02T: CLIMATE CHANGE MITIGATION TECHNOLOGIES RELATED TO TRANSPORTATION

## Abstract

An object detection model generation method as well as an electronic device and a computer readable storage medium using the same are provided. The method includes: during the iterative training of the to-be-trained object detection model, the detection accuracy of the iteration nodes of the object detection model is sequentially determined according to the node order, and the mis-detected negative samples of the object detection model at the iteration nodes with the detection accuracy less than or equal to a preset threshold are enhanced. Then the object detection model is trained at the iteration node based on the enhanced negative samples and a first amount of preset training samples. After the training at the iteration nodes are completed, it returns to the step of sequentially determining the detection accuracy of the iteration nodes of the object detection model until the training of the object detection model is completed.

## Claims

### Claim 1

An object detection model generation method, comprising steps of:
inputting a preset first amount of training samples into a to-be-trained object detection model, and performing an iterative training on the object detection model, wherein the training samples include one or more positive samples and one or more negative samples;
determining an untrained current iteration node as an object iteration node according to a node order, and obtaining one or more model parameters of the object detection model corresponding to a previous iteration node of the object iteration node;
determining a detection accuracy of the object detection model at the object iteration node based on the one or more model parameters;
obtaining one or more enhanced negative samples by enhancing one or more mis-detected negative samples of the object detection model at the object iteration node according to a preset negative sample enhancement rule, in response to the detection accuracy being less than or equal to a preset accuracy threshold;
training the object iteration node based on the one or more enhanced negative samples and the preset first amount of the training samples; and
returning to the determining the untrained current iteration node as the object iteration node according to the node order after the object iteration node is trained until the object detection model is trained.

### Claim 2 (depends on 1)

The method of claim 1, wherein after the determining the detection accuracy of the object detection model at the object iteration node based on the one or more model parameters, further comprises steps of:
training the object detection model at the object iteration node based on the preset first amount of the training samples, in response to the detection accuracy being larger than the preset accuracy threshold.

### Claim 3

The method of claim I, wherein the obtaining the one or more enhanced negative samples by enhancing the one or more mis-detected negative samples of the object detection model at the object iteration node according to the preset negative sample enhancement rule comprises:
obtaining the one or more mis-detected negative samples of the object detection model at the object iteration node;
obtaining one or more spliced images by splicing a preset second amount of the mis-detected negative samples and the positive samples at intervals; and
obtaining the one or more enhanced negative samples by cropping all the spliced images according to a preset cropping rule.

### Claim 4 (depends on 3)

The method of claim 3, wherein the spliced image is a grid image, and the mis-detected negative samples and the one or more positive samples are placed in grids of the grid image at intervals.

### Claim 5 (depends on 4)

The method of claim 4, wherein the obtaining the one or more enhanced negative samples by cropping all the spliced images according to the preset cropping rule comprises:
cropping the grid image according to a preset cropping size to obtain the grids of the grid image: and
taking the grid including the one or more mis-detected negative samples as the one or more enhanced negative samples.

### Claim 6 (depends on 3)

The method of claim 3, wherein the obtaining the one or more mis-detected negative samples of the object detection model at the object iteration node comprises:
determining the negative sample having detected as the positive sample when the object detection model performs object detection on each of the preset first amount of the training samples at the previous iteration node; and
obtaining the one or more mis-detected negative samples of the object detection model at the object iteration node by obtaining all the negative samples having detected as the positive sample.

### Claim 7 (depends on 1)

The method of claim 1, wherein the determining the detection accuracy of the object detection model at the object iteration node based on the one or more model parameters comprises:
taking the one or more model parameters as one or more variable of the object detection model at the object iteration node, and determining an Intersection over Union of the object detection model performing object detection on each of a preset third amount of the training samples; and
determining the detection accuracy of the object detection model at the object iteration node according to each Intersection over Union.

### Claim 8

An electronic device, comprising:
a processor;
a memory coupled to the processor; and
one or more computer programs stored in the memory and executable on the processor;
wherein, the one or more computer programs comprise:
instructions for inputting a preset first amount of training samples into a to-be-trained object detection model, and performing an iterative training on the object detection model, wherein the training samples include one or more positive samples and one or more negative samples;
instructions for determining an untrained current iteration node as an object iteration node according to a node order, and obtaining one or more model parameters of the object detection model corresponding to a previous iteration node of the object iteration node;
instructions for determining a detection accuracy of the object detection model at the object iteration node based on the one or more model parameters;
instructions for obtaining one or more enhanced negative samples by enhancing one or more mis-detected negative samples of the object detection model at the object iteration node according to a preset negative sample enhancement rule, in response to the detection accuracy being less than or equal to a preset accuracy threshold;
instructions for training the object iteration node based on the one or more enhanced negative samples and the preset first amount of the training samples; and
instructions for returning to the determining the untrained current iteration node as the object iteration node according to the node order after the object iteration node is trained until the object detection model is trained.

### Claim 9 (depends on 8)

The electronic device of claim 8, wherein the one or more computer programs further comprise:
instructions for training the object detection model at the object iteration node based on the preset first amount of the training samples, in response to the detection accuracy being larger than the preset accuracy threshold.

### Claim 10

The electronic device of claim K, wherein the instructions for obtaining the one or more enhanced negative samples by enhancing the one or more mis-detected negative samples of the object detection model at the object iteration node according to the preset negative sample enhancement rule comprise:
instructions for obtaining the one or more mis-detected negative samples of the object detection model at the object iteration node;
instructions for obtaining one or more spliced images by splicing a preset second amount of the mis-detected negative samples and the positive samples at intervals; and
instructions for obtaining the one or more enhanced negative samples by cropping all the spliced images according to a preset cropping rule.

### Claim 11 (depends on 10)

The electronic device of claim 10, wherein the spliced image is a grid image, and the mis-detected negative samples and the one or more positive samples are placed in grids of the grid image at intervals.

### Claim 12 (depends on 11)

The electronic device of claim 11, wherein the instructions tor obtaining the one or more enhanced negative samples by cropping all the spliced images according to the preset cropping rule comprise:
instructions for cropping the grid image according to a preset cropping size to obtain the grids of the grid image; and
instructions for taking the grid including the one or more mis-detected negative samples as the one or more enhanced negative samples.

### Claim 13 (depends on 10)

The electronic device of claim 10, wherein the instructions for obtaining the one or more mis-detected negative samples of the object detection model at the object iteration node comprise:
instructions for determining the negative sample having detected as the positive sample when the object detection model performs object detection on each of the preset first amount of the training samples at the previous iteration node; and
instructions for obtaining the one or more mis-detected negative samples of the object detection model at the object iteration node by obtaining all the negative samples having detected as the positive sample.

### Claim 14 (depends on 8)

The electronic device of claim 8, wherein the instructions for determining the detection accuracy of the object detection model at the object iteration node based on the one or more model parameters comprise:
instructions for taking the one or more model parameters as one or more variable of the object detection model at the object iteration node, and determining an Intersection over Union of the object detection model performing object detection on each of a preset third amount of the training samples; and
instructions for determining the detection accuracy of the object detection model at the object iteration node according to each Intersection over Union.

### Claim 15

A non-transitory computer readable storage medium for storing one or more computer programs, wherein the one or more computer programs comprise:
instructions for inputting a preset first amount of training samples into a to-be-trained object detection model, and performing an iterative training on the object detection model, wherein the training samples include one or more positive samples and one or more negative samples;
instructions for determining an untrained current iteration node as an object iteration node according to a node order, and obtaining one or more model parameters of the object detection model corresponding to a previous iteration node of the object iteration node;
instructions for determining a detection accuracy of the object detection model at the object iteration node based on the one or more model parameters;
instructions for obtaining one or more enhanced negative samples by enhancing one or more mis-detected negative samples of the object detection model at the object iteration node according to a preset negative sample enhancement rule, in response to the detection accuracy being less than or equal to a preset accuracy threshold;
instructions for training the object iteration node based on the one or more enhanced negative samples and the preset first amount of the training samples; and
instructions for returning to the determining the untrained current iteration node as the object iteration node according to the node order after the object iteration node is trained until the object detection model is trained.

### Claim 16 (depends on 15)

The storage medium of claim 15, wherein the one or more computer programs further comprise:
instructions for training the object detection model at the object iteration node based on the preset first amount of the training samples, in response to the detection accuracy being larger than the preset accuracy threshold.

### Claim 17 (depends on 15)

The storage medium of claim 15, wherein the instructions for obtaining the one or more enhanced negative samples by enhancing the one or more mis-detected negative samples of the object detection model at the object iteration node according to the preset negative sample enhancement rule comprise:
instructions for obtaining the one or more mis-detected negative samples of the object detection model at the object iteration node;
instructions for obtaining one or more spliced images by splicing a preset second amount of the mis-detected negative samples and the positive samples at intervals; and
instructions for obtaining the one or more enhanced negative samples by cropping all the spliced images according to a preset cropping rule.

### Claim 18 (depends on 17)

The storage medium of claim 17, wherein the spliced image is a grid image, and the mis-detected negative samples and the one or more positive samples are placed in grids of the grid image at intervals.

### Claim 19 (depends on 18)

The storage medium of claim 18, wherein the instructions for obtaining the one or more enhanced negative samples by cropping all the spliced images according to the preset cropping rule comprise:
instructions for cropping the grid image according to a preset crapping size to obtain the grids of the grid image; and
instructions for taking the grid including the one or more mis-detected negative samples as the one or more enhanced negative samples.

### Claim 20 (depends on 17)

The storage medium of claim 17, wherein the instructions for obtaining the one or more mis-detected negative samples of the object detection model at the object iteration node comprise:
instructions for determining the negative sample having detected as the positive sample when the object detection model performs object detection on each of the preset first amount of the training samples at the previous iteration node; and
instructions for obtaining the one or more mis-detected negative samples of the object detection model at the object iteration node by obtaining all the negative samples having detected as the positive sample.
