# US 2021/0343041 A1 · Method and apparatus for obtaining position of target, computer device, and storage medium

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0343041 A1
- Document ID: US20210343041A1
- Status: Published application
- Kind: A1
- Application number: 17/377,302
- Filed: 2021-07-15
- Published: 2021-11-04
- Earliest claimed: 2019-05-06
- Assignees: Tencent Technology (Shenzhen) Company Limited
- Applicants: Tencent Technology (Shenzhen) Company Limited
- Inventors: Ning WANG; Yibing SONG; Wei LIU
- Web page: https://patentgrep.com/patent/US20210343041A1

## CPC

- G06T 7/248: {involving reference images or patches}
- G06T 7/74: {involving reference images or patches}
- G06N 3/045: Combinations of networks
- G06N 3/0464: Convolutional networks [CNN, ConvNet]
- G06N 3/088: Non-supervised learning, e.g. competitive learning
- G06N 3/0895: Weakly supervised learning, e.g. semi-supervised or self-supervised learning
- G06N 20/00: Machine learning
- G06T 7/97: {Determining parameters from multiple pictures (depth or shape recovery from multiple images G06T7/55; stereo camera calibration G06T7/85)}
- G06T 2207/20081: Training; Learning
- G06T 2207/20084: Artificial neural networks [ANN]
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS

## Abstract

A method for obtaining a position of a target is provided. A plurality of frames of images is received. A first image in the plurality of frames of images includes a to-be-detected target. A position obtaining model is invoked, a model parameter of the position obtaining model is obtained through training based on a first position of a selected target in a first sample image and a second position of the selected target in the first sample image. The second position is predicted based on a third position of the selected target in a second sample image. The third position is predicted based on the first position. A position of the to-be-detected target in a second image is determined based on the model parameter and a position of the to-be-detected target in the first image via the position obtaining model.

## Claims

### Claim 1

A method for obtaining a position of a target, the method comprising:
receiving a plurality of frames of images, a first image in the plurality of frames of images including a to-be-detected target;
invoking a position obtaining model, a model parameter of the position obtaining model being obtained through training based on a first position of a selected target in a first sample image in a plurality of frames of sample images and a second position of the selected target in the first sample image, the second position being predicted based on a third position of the selected target in a second sample image in the plurality of frames of sample images, the third position being predicted based on the first position, the second sample image being different from the first sample image in the plurality of frames of sample images; and
determining, by processing circuitry, a position of the to-be-detected target in a second image based on the model parameter and a position of the to-be-detected target in the first image via the position obtaining model, the second image being different from the first image in the plurality of frames of images.

### Claim 2 (depends on 1)

The method according to claim 1, wherein the determining comprises:
determining an image processing parameter based on the position of the to-be-detected target in the first image, the first image, and the model parameter; and
processing the second image based on the image processing parameter, to determine the position of the to-be-detected target in the second image.

### Claim 3 (depends on 2)

The method according to claim 2, wherein
the determining the image processing parameter comprises:
generating position indication information corresponding to the first image based on the position of the to-be-detected target in the first image, the position indication information corresponding to the first image indicating a selected position of the to-be-detected target in the first image; and
determining the image processing parameter based on the position indication information corresponding to the first image, the first image, and the model parameter; and
the processing the second image includes processing the second image based on the image processing parameter, to determine position indication information corresponding to the second image, the position indication information corresponding to the second image indicating a predicted position of the to-be-detected target in the second image.

### Claim 4 (depends on 3)

The method according to claim 3, wherein
the determining the image processing parameter based on the position indication information comprises:
performing feature extraction on the first image based on the model parameter, to obtain an image feature of the first image; and
determining the image processing parameter based on the image feature of the first image and the position indication information corresponding to the first image; and
the processing the second image based on the image processing parameter, to determine the position indication information comprises:
performing feature extraction on the second image based on the model parameter, to obtain an image feature of the second image; and
processing the image feature of the second image based on the image processing parameter, to determine the position indication information corresponding to the second image.

### Claim 5 (depends on 1)

The method according to claim 1, wherein a training process of the position obtaining model comprises:
obtaining a plurality of frames of sample images;
invoking an initial model, randomly selecting, by using the initial model, a target area in the first sample image in the plurality of frames of sample images as the selected target, obtaining the third position of the selected target in the second sample image based on the first position of the selected target in the first sample image, the first sample image, and the second sample image, and obtaining the second position of the selected target in the first sample image based on the third position of the selected target in the second sample image, the first sample image, and the second sample image;
obtaining an error value of the second position relative to the first position based on the first position and the second position of the selected target in the first sample image; and
adjusting a model parameter of the initial model based on the error value until a target condition is met, to obtain the position obtaining model.

### Claim 6 (depends on 5)

The method according to claim 5, wherein
the obtaining the third position of the selected target in the second sample image includes:
obtaining a first image processing parameter based on the first position and the first sample image; and
processing the second sample image based on the first image processing parameter, to obtain the third position; and
the obtaining the second position of the selected target in the first sample image includes:
obtaining a second image processing parameter based on the third position and the second sample image; and
processing the first sample image based on the second image processing parameter, to obtain the second position.

### Claim 7 (depends on 6)

The method according to claim 6, wherein
the obtaining the first image processing parameter includes:
performing feature extraction on the first sample image based on the model parameter of the initial model, to obtain an image feature of the first sample image; and
obtaining the first image processing parameter based on the image feature of the first sample image and the first position; and
the processing the second sample image includes:
performing feature extraction on the second sample image based on the model parameter of the initial model, to obtain an image feature of the second sample image; and
processing the image feature of the second sample image based on the first image processing parameter, to obtain the third position.

### Claim 8 (depends on 5)

The method according to claim 5, wherein
the obtaining the third position of the selected target in the second sample image includes:
generating first position indication information corresponding to the first sample image based on the first position, the first position indication information indicating a selected position of the selected target in the first sample image; and
obtaining position indication information corresponding to the second sample image based on the first position indication information, the first sample image, and the second sample image, the position indication information corresponding to the second sample image indicating a predicted position of the selected target in the second sample image; and
the obtaining the second position of the selected target in the first sample image includes obtaining second position indication information corresponding to the first sample image based on the position indication information corresponding to the second sample image, the first sample image, and the second sample image, the second position indication information indicating a predicted position of the selected target in the first sample image.

### Claim 9 (depends on 5)

The method according to claim 5, wherein the plurality of frames of sample images includes a plurality of sample image sets, each of the sample image sets includes a first sample image and at least a second sample image, and each of the sample image sets corresponds to one error value; and
the adjusting the model parameter of the initial model includes adjusting, for each target quantity of sample image sets in the plurality of sample image sets, the model parameter of the initial model based on the plurality of error values corresponding to the target quantity of sample image sets.

### Claim 10 (depends on 9)

The method according to claim 9, wherein the adjusting the model parameter of the initial model based on a plurality of error values comprises any one of the following:
removing error values meeting an error value condition in the plurality of error values based on the plurality of error values corresponding to the target quantity of sample image sets; and adjusting the model parameter of the initial model based on the remaining error values; or
determining first weights of the plurality of error values based on the plurality of error values corresponding to the target quantity of sample image sets; and adjusting the model parameter of the initial model based on the first weights of the plurality of error values and the plurality of error values, the first weights of error values meeting an error value condition in the plurality of error values being zero.

### Claim 11 (depends on 9)

The method according to claim 9, wherein
each of the sample image sets corresponds to a second weight; and
the adjusting the model parameter of the initial model based on the plurality of error values includes:
obtaining the second weight of the error value of each of the sample image sets, the second weight being positively correlated with a displacement of the selected target in the plurality of frames of sample images in the respective sample image set; and
adjusting the model parameter of the initial model based on the plurality of error values and the plurality of second weights corresponding to the target quantity of sample image sets.

### Claim 12

A method for obtaining a position of a target, the method comprising:
obtaining a plurality of frames of sample images;
invoking an initial model, obtaining, based on a first position of a selected target in a first sample image in the plurality of frames of sample images according to the initial model, a third position of the selected target in a second sample image, obtaining a second position of the selected target in the first sample image based on the third position of the selected target in the second sample image, and adjusting a model parameter of the initial model based on the first position and the second position, to obtain a position obtaining model, the selected target being obtained by randomly selecting a target area in the first sample image by the initial model, the second sample image being different from the first sample image in the plurality of frames of sample images; and
invoking the position obtaining model when a plurality of frames of images is obtained, and determining positions of a to-be-detected target in the plurality of frames of images according to the position obtaining model.

### Claim 13

An apparatus, comprising:
processing circuitry configured to:
receive a plurality of frames of images, a first image in the plurality of frames of images including a to-be-detected target;
invoke a position obtaining model, a model parameter of the position obtaining model being obtained through training based on a first position of a selected target in a first sample image in a plurality of frames of sample images and a second position of the selected target in the first sample image, the second position being predicted based on a third position of the selected target in a second sample image in the plurality of frames of sample images, the third position being predicted based on the first position, the second sample image being different from the first sample image in the plurality of frames of sample images; and
determine a position of the to-be-detected target in a second image based on the model parameter and a position of the to-be-detected target in the first image via the position obtaining model, the second image being different from the first image in the plurality of frames of images.

### Claim 14 (depends on 13)

The apparatus according to claim 13, wherein the processing circuitry is configured to:
determine an image processing parameter based on the position of the to-be-detected target in the first image, the first image, and the model parameter; and
process the second image based on the image processing parameter, to determine the position of the to-be-detected target in the second image.

### Claim 15 (depends on 14)

The apparatus according to claim 14, wherein the processing circuitry is configured to:
generate position indication information corresponding to the first image based on the position of the to-be-detected target in the first image, the position indication information corresponding to the first image indicating a selected position of the to-be-detected target in the first image;
determine the image processing parameter based on the position indication information corresponding to the first image, the first image, and the model parameter; and
process the second image based on the image processing parameter, to determine position indication information corresponding to the second image, the position indication information corresponding to the second image indicating a predicted position of the to-be-detected target in the second image.

### Claim 16 (depends on 15)

The apparatus according to claim 15, wherein the processing circuitry is configured to:
perform feature extraction on the first image based on the model parameter, to obtain an image feature of the first image;
determine the image processing parameter based on the image feature of the first image and the position indication information corresponding to the first image;
perform feature extraction on the second image based on the model parameter, to obtain an image feature of the second image; and
process the image feature of the second image based on the image processing parameter, to determine the position indication information corresponding to the second image.

### Claim 17 (depends on 13)

The apparatus according to claim 13, wherein in a training process of the position obtaining model,
a plurality of frames of sample images is obtained;
an initial model is invoked, a target area in the first sample image in the plurality of frames of sample images is randomly selected, by using the initial model, as the selected target, the third position of the selected target in the second sample image is obtained based on the first position of the selected target in the first sample image, the first sample image, and the second sample image, and the second position of the selected target in the first sample image is obtained based on the third position of the selected target in the second sample image, the first sample image, and the second sample image;
an error value of the second position relative to the first position is obtained based on the first position and the second position of the selected target in the first sample image; and
a model parameter of the initial model is adjusted based on the error value until a target condition is met, to obtain the position obtaining model.

### Claim 18 (depends on 17)

The apparatus according to claim 17, wherein
the third position of the selected target in the second sample image is obtained by
obtaining a first image processing parameter based on the first position and the first sample image; and
processing the second sample image based on the first image processing parameter, to obtain the third position; and
the second position of the selected target in the first sample image is obtained by
obtaining a second image processing parameter based on the third position and the second sample image; and
processing the first sample image based on the second image processing parameter, to obtain the second position.

### Claim 19 (depends on 1)

A non-transitory computer-readable storage medium storing instructions which when executed by a processor cause the processor to perform the method according to claim 1.

### Claim 20 (depends on 12)

A non-transitory computer-readable storage medium storing instructions which when executed by a processor cause the processor to perform the method according to claim 12.
