# US 2021/0174079 A1 · Method and apparatus for object recognition

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0174079 A1
- Document ID: US20210174079A1
- Status: Published application
- Kind: A1
- Application number: 16/726,825
- Filed: 2019-12-25
- Published: 2021-06-10
- Earliest claimed: 2019-12-10
- Assignees: Industrial Technology Research Institute
- Applicants: Industrial Technology Research Institute
- Inventors: Li-Pei Wang; Guan-De Li; Kang-Hao Chaio; Hung-Hsuan Lin
- Web page: https://patentgrep.com/patent/US20210174079A1

## CPC

- G06T 7/246: using feature-based methods, e.g. the tracking of corners or segments
- G06T 7/11: Region-based segmentation
- G06T 7/149: involving deformable models, e.g. active contour models
- G06V 10/50: by performing operations within image blocks; by using histograms, e.g. histogram of oriented gradients [HoG]; by summing image-intensity values; Projection analysis
- G06V 20/00: Scenes; Scene-specific elements (control of digital cameras H04N23/60)
- G06V 20/52: Surveillance or monitoring of activities, e.g. for recognising suspicious objects (recognising microscopic objects G06V20/69)
- G06T 2207/10016: Video; Image sequence
- G06T 2207/20021: Dividing image into blocks, subimages or windows
- G06T 2207/20121: Active appearance model [AAM]
- G06V 10/62: relating to a temporal dimension, e.g. time-based feature extraction; Pattern tracking
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

A method and an apparatus for object recognition are provided. The method includes: receiving a video including a plurality of frames, and separating the frames into a plurality of frame groups; executing object recognition on a specific frame in each of the frame groups to recognize at least one object in the specific frame; dividing a bounded area of each object into a plurality of sub-blocks, and sampling at least one feature point within at least one of the sub-blocks; and tracking each object in the frames in the frame group according to a variation of the feature point in the frames in the frame group.

## Claims

### Claim 1

A method for object recognition, applicable to an electronic apparatus that comprises a processor, wherein the method comprises:
receiving a video comprising a plurality of frames, and separating the frames into a plurality of frame groups;
executing object recognition on a specific frame in each of the frame groups to recognize at least one object in the specific frame;
dividing a bounded area of each of the at least one object into a plurality of sub-blocks, and sampling at least one feature point within at least one sub-block of the sub-blocks; and
tracking the at least one object in the frames in the frame group according to a variation of the at least one feature point in the frames in the frame group.

### Claim 2 (depends on 1)

The method according to claim 1, wherein executing object recognition on the specific frame in each of the frame groups to recognize the at least one object in the specific frame comprises:
executing object recognition on a first frame in each of the frame groups to recognize the at least one object in the first frame.

### Claim 3 (depends on 1)

The method according to claim 1, wherein sampling the at least one feature point within the at least one sub-block of the sub-blocks comprises:
sampling the at least one feature point within a central sub-block located at a center of the sub-blocks.

### Claim 4 (depends on 1)

The method according to claim 1, wherein sampling the at least one feature point within the at least one sub-block of the sub-blocks and the tracking the at least one object in the frames in the frame group according to the variation of the at least one feature point in the frames in the frame group comprise:
sampling a plurality of optical flow tracking points randomly in the at least one sub-block of the sub-blocks as the at least one feature point; and
using a sparse optical flow method to track a variation of the optical flow tracking points in the frames in the frame group, to track the at least one object in the frames in the frame group.

### Claim 5 (depends on 1)

The method according to claim 1, wherein sampling the at least one feature point within the at least one sub-block of the sub-blocks comprises:
calculating an average displacement of the at least one feature point within the sub-block; and
selecting a neighboring sub-block in the average displacement to replace a current sub-block, and re-sampling the at least one feature point within the neighboring sub-block for tracking.

### Claim 6 (depends on 1)

The method according to claim 1, wherein tracking the at least one object in the frames in the frame group according to the variation of the at least one feature point in the frames in the frame group comprises:
calculating an average displacement of the feature point; and
changing a position of the bounded area of the object according to the calculated average displacement.

### Claim 7 (depends on 1)

The method according to claim 1, wherein tracking the at least one object in the frames in the frame group according to the variation of the at least one feature point in the frames in the frame group comprises:
calculating a change of interval between the at least one feature point; and
changing a size of the bounded area of the at least one object according to a difference in the calculated change of interval.

### Claim 8 (depends on 1)

The method according to claim 1, wherein the at least one object comprises a first object and a second object, and the tracking the at least one object in the frames in the frame group according to the variation of the at least one feature point in the frames in the frame group comprises:
determining whether a bounded area of the first object overlaps a bounded area of the second object; and
when the bounded area of the first object overlaps the bounded area of the second object, using the at least one feature point sampled in the first object and excluding the at least one feature point sampled in the second object to track the first object.

### Claim 9 (depends on 1)

The method according to claim 1, wherein the bounded area of each of the at least one object is a smallest rectangle that can cover the at least one object.

### Claim 10 (depends on 1)

The method according to claim 1, wherein sampling the at least one feature point within the at least one sub-block of the sub-blocks comprises:
among the sub-blocks, selecting the at least one sub-block with a largest area covering the at least one object to sample the at least one feature point.

### Claim 11 (depends on 1)

The method according to claim 1, wherein sampling the at least one feature point within the at least one sub-block of the sub-blocks comprises:
determining, according to characteristics of the at least one object, a sub-block in which the at least one feature point is sampled.

### Claim 12

An apparatus for object recognition, comprising:
an input/output apparatus, coupled to an image source apparatus and configured to receive a video comprising a plurality of frames from the image source apparatus;
a storage apparatus, configured to store the video received by the input/output apparatus; and
a processor, coupled to the input/output apparatus and the storage apparatus, and configured to separate the frames in the video into a plurality of frame groups, execute object recognition on a specific frame in each of the frame groups to recognize at least one object in the specific frame, divide a bounded area of each of the at least one object into a plurality of sub-blocks, and sample at least one feature point within at least one sub-block of the sub-blocks, and track the at least one object in the frames in the frame group according to a variation of the at least one feature point in the frames in the frame group.

### Claim 13 (depends on 12)

The apparatus for object recognition according to claim 12, wherein the processor executes object recognition on a first frame in each of the frame groups to recognize the at least one object in the first frame.

### Claim 14 (depends on 12)

The apparatus for object recognition according to claim 12, wherein the processor samples the at least one feature point within a central sub-block located at a center of the sub-blocks.

### Claim 15 (depends on 12)

The apparatus for object recognition according to claim 12, wherein the processor samples a plurality of optical flow tracking points randomly in the at least one sub-block of the sub-blocks as the at least one feature point, and uses a sparse optical flow method to track a variation of the optical flow tracking points in the frames in the frame group, to track the at least one object in the frames in the frame group.

### Claim 16 (depends on 12)

The apparatus for object recognition according to claim 12, wherein the processor calculates an average displacement of the at least one feature point within the sub-block, selects a neighboring sub-block in the average displacement to replace a current sub-block, and re-samples the at least one feature point within the neighboring sub-block for tracking.

### Claim 17 (depends on 12)

The apparatus for object recognition according to claim 12, wherein the processor calculates an average displacement of the at least one feature point, and changes a position of the bounded area of the at least one object according to the calculated average displacement.

### Claim 18 (depends on 12)

The apparatus for object recognition according to claim 12, wherein the processor calculates a change of interval between the at least one feature point, and changes a size of the bounded area of the at least one object according to a difference in the calculated change of interval.

### Claim 19 (depends on 12)

The apparatus for object recognition according to claim 12, wherein the at least one object comprises a first object and a second object, and the processor determines whether a bounded area of the first object overlaps a bounded area of the second object, and when the bounded area of the first object overlaps the bounded area of the second object, the processor uses the at least one feature point sampled in the first object and excludes the at least one feature point sampled in the second object to track the first object.
