# US 2022/0284601 A1 · Determining x,y,z,t biomechanics of moving actor with multiple cameras

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0284601 A1
- Document ID: US20220284601A1
- Status: Published application
- Kind: A1
- Application number: 17/752,421
- Filed: 2022-05-24
- Published: 2022-09-08
- Earliest claimed: 2015-04-15
- Assignees: SportsMEDIA Technology Corporation
- Applicants: SportsMEDIA Technology Corporation
- Inventors: Mark Perry; Joshua Spivak; Ryan A. Zander; Graham Wei-Feng Goldbeck; James G. Painter
- Web page: https://patentgrep.com/patent/US20220284601A1

## CPC

- G06T 7/292: Multi-camera tracking
- H04N 23/90: Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
- G06T 2200/04: involving 3D image data
- G06T 2207/10012: Stereo images
- G06T 2207/10016: Video; Image sequence
- G06T 2207/30196: Human being; Person
- G06T 2207/30221: Sports video; Sports image
- G06T 2207/30241: Trajectory
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A plurality of tracking cameras is pointed towards a routine hovering area of an in-the-field sports participant who routinely hovers about that area. Spots within the hovering area are registered relative to a predetermined multi-dimensional coordinates reference frame (e.g., Xw, Yw, Zw, Tw) such that two-dimensional coordinates of 2D images captured by the tracking cameras can be converted to multi-dimensional coordinates of the reference frame. A body part recognizing unit recognizes 2D locations of a specific body part in the 2D captured images and a mapping unit maps them into the multi-dimensional coordinates of the reference frame. A multi-dimensional curve generator then generates a multi-dimensional motion curve describing motion of the body part based on the mapped coordinates (e.g., Xw, Yw, Zw, Tw). The generated multi-dimensional motion curve is used to discover cross correlations between play action motions of the in-the-field sports participant and real-world sports results.

## Claims

### Claim 1

A system for determining performance attributes comprising:
at least one processor configured for network communication with at least one server computer and/or at least one local computing device;
wherein the at least one processor is operable to:
receive images;
develop a motion curve;
identify frames and/or scan lines from the images associated with spatial points on the motion curve; and
display the frames and/or the scan lines on the at least one server computer and/or the at least one local computing device.

### Claim 2 (depends on 1)

The system of claim 1, wherein the at least one processor is operable to develop the motion curve using respective temporal segment lengths from the images.

### Claim 3 (depends on 1)

The system of claim 1, wherein the at least one processor is operable to intertwine and temporally dispose the images along a common timing reference and discard temporally adjacent images.

### Claim 4 (depends on 1)

The system of claim 1, wherein the at least one server computer and/or the at least one local computing device is operable to display frames corresponding to an identified spatial point on the motion curve.

### Claim 5 (depends on 1)

The system of claim 1, wherein a 3D position is determined by merging the images using a least squares or other error reduction technique.

### Claim 6 (depends on 1)

The system of claim 1, wherein 3D coordinates of pre-registered references spots are known, and wherein when a pre-registered reference spot is captured in an image, coordinates of the image are automatically converted to the 3D coordinates.

### Claim 7 (depends on 1)

The system of claim 1, wherein a database stores in-the-field biometric attributes including a heart rate, a breathing rate, a perspiration level, a blood pressure, a galvanic skin response, a topical temperature, and/or cranial electrical activity of a sports participant recorded at the same time as a play action activity.

### Claim 8 (depends on 1)

The system of claim 1, wherein the motion curve is a multi-dimensional motion curve.

### Claim 9

A system for determining performance attributes comprising:
at least one processor configured for network communication with at least one server computer and/or at least one local computing device;
wherein the at least one processor is operable to:
receive images; and
develop a multi-dimensional (mD) motion curve.

### Claim 10 (depends on 9)

The system of claim 9, wherein inconsistencies between the images are resolved based on biomechanical rules of nature or physical rules of nature.

### Claim 11 (depends on 9)

The system of claim 9, wherein the at least one processor is operable to intertwine and temporally dispose the images along a common timing reference and discard temporally adjacent images.

### Claim 12 (depends on 9)

The system of claim 9, wherein the at least one processor is operable to construct a four-dimensional (4D) model based on the images.

### Claim 13 (depends on 12)

The system of claim 12, wherein the at least one processor stores cross associating points of motion relating to environmental conditions and sport event results with the 4D model in a database.

### Claim 14 (depends on 9)

The system of claim 9, wherein the at least one processor develops the mD motion curve within a mD space having at least a time (Tw) axis and three spatial and orthogonal coordinate axes (Xw, Yw, Zw).

### Claim 15 (depends on 9)

The system of claim 9, wherein a database stores data relating to a sports participant and data including sport event results, and wherein the database is operable to return data and images in response to a user query.

### Claim 16

A system for determining performance attributes comprising:
at least one processor configured for network communication with at least one server computer and/or at least one local computing device;
wherein the at least one processor is operable to:
receive images;
determine a common timing reference for placing the images; and
intertwine the images such that the images are approximately disposed in a temporal sense along the common timing reference.

### Claim 17 (depends on 16)

The system of claim 16, wherein the at least one processor is operable to develop a multi-dimensional (mD) motion curve.

### Claim 18 (depends on 17)

The system of claim 17, wherein the at least one processor is operable to identify frames and/or scan lines that correspond with spatial points along the mD motion curve.

### Claim 19 (depends on 17)

The system of claim 17, wherein the at least one processor is operable to fit the mD motion curve with curve fit optimization techniques relative to the images where a subset of the images is given greater weight due to closeness and/or a better point of view (POV).

### Claim 20 (depends on 16)

The system of claim 16, wherein the at least one processor is operable to automatically determine the start and/or end of a play action activity and generate a unique ID label for the play action activity.
