# US 2024/0202939 A1 · Computer method and apparatus for tagless tracking of livestock

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0202939 A1
- Document ID: US20240202939A1
- Status: Published application
- Kind: A1
- Application number: 18/537,899
- Filed: 2023-12-13
- Published: 2024-06-20
- Earliest claimed: 2022-12-14
- Assignees: The Main Branch, Inc.
- Applicants: The Main Branch, Inc.
- Inventors: Octavian Alexandru BLAGA; David Benjamin SCOTT
- Web page: https://patentgrep.com/patent/US20240202939A1

## CPC

- G06T 7/246: using feature-based methods, e.g. the tracking of corners or segments
- A01K 11/006: {Automatic identification systems for animals, e.g. electronic devices, transponders for animals (identification systems for access to feeding pens A01K1/0209; ear tags with electronic identification means A01K11/004)}
- A01K 29/005: {Monitoring or measuring activity}
- A61B 5/0077: {Devices for viewing the surface of the body, e.g. camera, magnifying lens}
- A61B 5/02416: {using photoplethysmograph signals, e.g. generated by infrared radiation (A61B5/14552 takes precedence)}
- A61B 5/0816: {Measuring devices for examining respiratory frequency (measuring frequency of electric signals G01R23/00)}
- A61B 5/742: {using visual displays (displays for heart-related electrical signals, e.g. ECG, A61B5/339)}
- G06T 5/70: Denoising; Smoothing
- G06T 7/0012: {Biomedical image inspection}
- G06T 7/277: involving stochastic approaches, e.g. using Kalman filters
- G06T 7/73: using feature-based methods
- G06V 10/26: Segmentation of patterns in the image field; Cutting or merging of image elements to establish the pattern region, e.g. clustering-based techniques; Detection of occlusion
- G06V 10/30: Noise filtering
- G06V 10/44: Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
- G06V 10/751: {Comparing pixel values or logical combinations thereof, or feature values having positional relevance, e.g. template matching}
- G06V 10/764: using classification, e.g. of video objects
- G06V 40/10: Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- A61B 2503/40: Animals
- G06T 2207/10016: Video; Image sequence
- G06T 2207/20221: Image fusion; Image merging
- G06T 2207/30004: Biomedical image processing
- G06T 2207/30232: Surveillance
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- A01K: ANIMAL HUSBANDRY; AVICULTURE; APICULTURE; PISCICULTURE; FISHING; REARING OR BREEDING ANIMALS, NOT OTHERWISE PROVIDED FOR; NEW BREEDS OF ANIMALS
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

A computer method provides tagless tracking of livestock. Individual livestock are identified using biometric identification. Biometric identities are associated with digital identities. The method reconciles image analysis and tracking errors iteratively.

## Claims

### Claim 1

A computer method for livestock tracking and biometric identification, comprising:
receiving, into a computer, a first digital video or sequence of digital photographic frames from one or more digital image capture devices, the first digital video or sequence of digital photographic frames including a plurality of livestock locations;
assigning a digital identity to each livestock individual;
tracking locations of the livestock individuals as the livestock mill about;
receiving a second digital video or digital photographic frame including at least a portion of a biometric identification area of an individual livestock body;
performing a biometric deep sort to produce at least a portion of an individual livestock biometric identity; and
associating the individual livestock biometric identity with the corresponding livestock digital identity.

### Claim 2 (depends on 1)

The computer method of claim 1, further comprising:
displaying a labeled image on an electronic display, the labeled image including the current digital identities corresponding each livestock individual.

### Claim 3 (depends on 1)

The computer method of claim 1, wherein tracking locations of the livestock individuals as the livestock mill about is performed using a Kalman filter.

### Claim 4 (depends on 1)

The computer method of claim 1, wherein performing the biometric deep sort further comprises operating a Harris feature to locate livestock biometric markers.

### Claim 5 (depends on 1)

The computer method of claim 1, wherein performing the biometric deep sort further comprises:
identifying, on a grid, relative locations of individual livestock biometric markers; and
storing the grid locations in an individual livestock biometric identity record in a livestock population model.

### Claim 6 (depends on 5)

The computer method of claim 5, wherein the individual livestock biometric markers include at least two selected from the group consisting of a corner of an eye, a corner formed by a horn, a corner formed by an ear, a snout corner, a hide color corner, a hoof corner, and a tail corner.

### Claim 7 (depends on 5)

The computer method of claim 5, wherein identifying individual biometric markers includes:
assigning classes of livestock body surface features; and
performing a semantic segmentation to classify each pixel as belonging to a livestock body surface feature.

### Claim 8 (depends on 7)

The computer method of claim 7, wherein assigning classes of livestock body surface features includes assigning livestock eye and livestock snout classes.

### Claim 9 (depends on 7)

The computer method of claim 7, wherein assigning classes of livestock body surface features includes assigning livestock eye corners and assigning livestock snout corners.

### Claim 10 (depends on 1)

The computer method of claim 1, wherein the first digital video or sequence of digital photographic frames includes a wider angle view including a plurality of livestock in the frame; and
wherein the second digital video or sequence of digital photographic frames includes a narrower angle view that includes less than all of the plurality of livestock in the frame.

### Claim 11 (depends on 10)

The computer method of claim 10, wherein the narrower angle view primarily includes at least a portion of an individual livestock.

### Claim 12 (depends on 10)

The computer method of claim 10, wherein the narrower angle view consists essentially of the biometric identification area of the individual livestock's body.

### Claim 13 (depends on 1)

The computer method of claim 1, further comprising:
tracking an individual livestock as the livestock mill about, the individual livestock nominally being assigned a livestock digital identity;
performing a second biometric identification of the individual livestock; and
verifying that the tracked individual livestock is the individual livestock associated with the livestock digital identity.

### Claim 14 (depends on 1)

The computer method of claim 1, further comprising:
tracking individual livestock as the livestock mill about, the individual livestock nominally being assigned livestock digital identities;
receiving the second digital video or digital photographic frame corresponding to one of the individual livestock and including at least a portion of the biometric identification area of the individual livestock body;
performing biometric identification of the individual livestock;
determining the individual livestock does not match a biometric identity of an individual livestock and
associating the individual livestock biometric identity with the corresponding livestock digital identity.

### Claim 15 (depends on 1)

The computer method of claim 1, further comprising:
tracking an individual livestock as the livestock mill about, the individual livestock nominally being assigned a livestock digital identity;
performing biometric identification of the individual livestock;
determining that the biometric identity includes biometric markers not previously included in the biometric identity of the individual livestock; and
augmenting the biometric identity with the additional biometric markers.

### Claim 16 (depends on 1)

The computer method of claim 1, further comprising:
tracking a first individual livestock as the livestock mill about, the first individual livestock nominally being assigned a livestock digital identity;
performing biometric identification of the first individual livestock;
determining that the tracked first individual livestock is an individual livestock associated with a different livestock digital identity than an incorrect livestock digital identity currently assigned to the first individual livestock; and
assigning the correct livestock digital identity to the first individual livestock.

### Claim 17 (depends on 16)

The computer method of claim 16, further comprising:
assigning the incorrect livestock digital identity previously associated with the first individual livestock to a second individual livestock.

### Claim 18 (depends on 1)

The computer method of claim 1, wherein the livestock are cows and/or steers.
