# US 2021/0334525 A1 · Systems and methods for identifying a unified entity from a plurality of discrete parts

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0334525 A1
- Document ID: US20210334525A1
- Status: Published application
- Kind: A1
- Application number: 16/859,214
- Filed: 2020-04-27
- Published: 2021-10-28
- Earliest claimed: 2020-04-27
- Assignees: Ademco Inc.
- Applicants: Ademco Inc.
- Inventors: Soumitri Kolavennu; Nathaniel Kraft
- Web page: https://patentgrep.com/patent/US20210334525A1

## CPC

- G06T 7/251: {involving models}
- G06F 18/214: Generating training patterns; Bootstrap methods, e.g. bagging or boosting
- G06N 5/01: Dynamic search techniques; Heuristics; Dynamic trees; Branch-and-bound
- G06N 5/04: Inference or reasoning models
- G06N 20/00: Machine learning
- G06T 7/20: Analysis of motion (motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51)
- G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80)
- G06V 10/25: Determination of region of interest [ROI] or a volume of interest [VOI]
- G06V 10/774: Generating sets of training patterns; Bootstrap methods, e.g. bagging or boosting
- G06V 40/10: Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06T 2207/10016: Video; Image sequence
- G06T 2207/20081: Training; Learning
- G06T 2207/30196: Human being; Person
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

Disclosed systems and methods can include capturing the sequence of images of a monitored region that includes a sub-region of interest, processing the sequence of images using heuristics and rules of an artificial intelligence model to identify the plurality of discrete parts that are associated with a type of a unified entity, and processing the sequence of images using the heuristics and the rules of the artificial intelligence model to virtually link together a group of the plurality of discrete parts that correspond to a specific embodiment of the unified entity that is present in the sub-region of interest, wherein the heuristics and the rules of the artificial intelligence model can be developed from a training process that includes the artificial intelligence model receiving sample images delineating exemplary discrete parts on exemplary embodiments of the unified entity.

## Claims

### Claim 1

A system comprising:
a camera that captures a sequence of images of a monitored region that includes a sub-region of interest; and
a processor that receives the sequence of images and processes the sequence of images using heuristics and rules of an artificial intelligence model to (1) identify a plurality of discrete parts that are associated with a type of a unified entity and (2) virtually link together a group of the plurality of discrete parts that correspond to a specific embodiment of the unified entity that is present in the sub-region of interest,
wherein the heuristics and the rules of the artificial intelligence model are developed from a training process that includes the artificial intelligence model receiving sample images delineating exemplary discrete parts on exemplary embodiments of the unified entity.

### Claim 2 (depends on 1)

The system of claim 1 wherein the type of the unified entity includes a human, wherein the plurality of discrete parts includes individual body parts of the human, wherein the specific embodiment of the unified entity includes a specific person present in the sub-region of interest, wherein the exemplary discrete parts include exemplary body parts, and wherein the exemplary embodiments of the unified entity include one or more exemplary persons.

### Claim 3 (depends on 1)

The system of claim 1 wherein the processor tracks the specific embodiment of the unified entity relative to one or more obstacles in the sub-region of interest by tracking movement of each of the group of the plurality of discrete parts.

### Claim 4 (depends on 3)

The system of claim 3 wherein the processor uses the heuristics and the rules of the artificial intelligence model to determine whether the specific embodiment of the unified entity is at least partially occluded by the one or more obstacles, and wherein the training process includes the artificial intelligence model identifying the exemplary embodiments of the unified entity being at least partially occluded by the one or more obstacles.

### Claim 5 (depends on 3)

The system of claim 3 wherein the one or more obstacles include an underwater area of the sub-region of interest.

### Claim 6 (depends on 1)

The system of claim 1 wherein the group of the plurality of discrete parts includes visible ones of the plurality of discrete parts and at least partially occluded ones of the plurality of discrete parts, and wherein the processor uses the heuristics and the rules of the artificial intelligence model to identify the at least partially occluded ones of the plurality of discrete parts based on a respective type of each of the visible ones of the plurality of discrete parts, a respective location of each of the visible ones of the plurality of discrete parts, and locations of one or more obstacles within the sub-region of interest.

### Claim 7 (depends on 1)

The system of claim 1 wherein the heuristics and the rules of the artificial intelligence model virtually link together the group of the plurality of discrete parts based on extrapolating from exemplary groupings of the exemplary discrete parts delineated in the exemplary embodiments of the unified entity as identified in the sample images.

### Claim 8 (depends on 1)

The system of claim 1 wherein the heuristics and the rules of the artificial intelligence model virtually link together the group of the plurality of discrete parts by identifying a respective type of each of the plurality of discrete parts, identifying a respective location of each of the plurality of discrete parts, and identifying each of the plurality of discrete parts for which the respective type and the respective location conform to a model of the unified entity developed from the training process.

### Claim 9 (depends on 1)

The system of claim 1 wherein the processor uses the heuristics and the rules of the artificial intelligence model to determine whether movement of each of the group of the plurality of discrete parts is indicative of an emergency situation or an alarm situation, and wherein the training process includes the artificial intelligence model identifying positions of the exemplary discrete parts during the emergency situation or the alarm situation.

### Claim 10 (depends on 1)

The system of claim 1 wherein the processor uses the heuristics and the rules of the artificial intelligence model to determine whether movement of each of the group of the plurality of discrete parts is indicative of unauthorized access to the sub-region of interest, and wherein the training process includes the artificial intelligence model identifying the unauthorized access to the sub-region of interest.

### Claim 11

A method comprising:
capturing a sequence of images of a monitored region that includes a sub-region of interest;
processing the sequence of images using heuristics and rules of an artificial intelligence model to identify a plurality of discrete parts that are associated with a type of a unified entity; and
processing the sequence of images using the heuristics and the rules of the artificial intelligence model to virtually link together a group of the plurality of discrete parts that correspond to a specific embodiment of the unified entity that is present in the sub-region of interest,
wherein the heuristics and the rules of the artificial intelligence model are developed from a training process that includes the artificial intelligence model receiving sample images delineating exemplary discrete parts on exemplary embodiments of the unified entity.

### Claim 12 (depends on 11)

The method of claim 11 wherein the type of the unified entity includes a human, wherein the plurality of discrete parts includes individual body parts of the human, wherein the specific embodiment of the unified entity includes a specific person present in the sub-region of interest, wherein the exemplary discrete parts include exemplary body parts, and wherein the exemplary embodiments of the unified entity include one or more exemplary persons.

### Claim 13 (depends on 11)

The method of claim 11 further comprising:
tracking the specific embodiment of the unified entity relative to one or more obstacles in the sub-region of interest by tracking movement of each of the group of the plurality of discrete parts.

### Claim 14 (depends on 13)

The method of claim 13 further comprising:
using the heuristics and the rules of the artificial intelligence model to determine whether the specific embodiment of the unified entity is at least partially occluded by the one or more obstacles,
wherein the training process includes the artificial intelligence model identifying the exemplary embodiments of the unified entity being at least partially occluded by the one or more obstacles.

### Claim 15 (depends on 13)

The method of claim 13 wherein the one or more obstacles include an underwater area of the sub-region of interest.

### Claim 16 (depends on 11)

The method of claim 11 further comprising:
using the heuristics and the rules of the artificial intelligence model to identify at least partially occluded ones of the plurality of discrete parts in the group of the plurality of discrete parts based on a respective type of each of visible ones of the plurality of discrete parts in the group of the plurality of discrete parts, a respective location of each of the visible ones of the plurality of discrete parts, and locations of one or more obstacles within the sub-region of interest.

### Claim 17 (depends on 11)

The method of claim 11 further comprising:
using the heuristics and the rules of the artificial intelligence model to virtually link together the group of the plurality of discrete parts by extrapolating from exemplary groupings of the exemplary discrete parts delineated in the exemplary embodiments of the unified entity as identified in the sample images.

### Claim 18 (depends on 11)

The method of claim 11 further comprising:
using the heuristics and the rules of the artificial intelligence model to virtually link together the group of the plurality of discrete parts by identifying a respective type of each of the plurality of discrete parts, identifying a respective location of each of the plurality of discrete parts, and identifying each of the plurality of discrete parts for which the respective type and the respective location conform to a model of the unified entity developed from the training process.

### Claim 19 (depends on 11)

The method of claim 11 further comprising:
using the heuristics and the rules of the artificial intelligence model to determine whether movement of each of the group of the plurality of discrete parts is indicative of an emergency situation or an alarm situation,
wherein the training process includes the artificial intelligence model identifying positions of the exemplary discrete parts during the emergency situation or the alarm situation.

### Claim 20 (depends on 11)

The method of claim 11 further comprising:
using the heuristics and the rules of the artificial intelligence model to determine whether movement of each of the group of the plurality of discrete parts is indicative of unauthorized access to the sub-region of interest,
wherein the training process includes the artificial intelligence model identifying the unauthorized access to the sub-region of interest.
