# US 12,217,770 B1 · Player spotlight

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,217,770 B1
- Document ID: US12217770B1
- Status: Granted
- Kind: B1
- Application number: 17/305,127
- Filed: 2021-06-30
- Granted: 2025-02-04
- Earliest claimed: 2021-06-30
- Assignees: Amazon Technologies, Inc.
- Applicants: Amazon Technologies, Inc.
- Inventors: Lokesh Amarnath Ravindranathan; Kaustav Nandy; Manivel Sethu; Yongjun Wu; Imran Khan; Shivam Agarwal; Yash Pandya
- Web page: https://patentgrep.com/patent/US12217770B1

## CPC

- G11B 27/036: Insert-editing
- G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80)
- G06T 11/10: Texturing; Colouring; Generation of textures or colours (retouching, inpainting or scratch removal G06T5/77)
- G06V 10/225: {based on a marking or identifier characterising the area}
- G06V 20/42: {of sport video content}
- G06V 40/10: Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06T 2207/10016: Video; Image sequence
- G06T 2210/12: Bounding box
- G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

Some implementations include methods generating visualization emphasis object for players and may include receiving a video clip associated with a sporting event participated by a plurality of players using a playing field with a play object. The players in a frame of the video clip may be detected. Players who are on the playing field may be identified from the detected players. Each of the players identified to be on the playing field may be associated with a rectangular bounding box that provides an outline of each of the players. A player who has possession of the play object may be identified. A visualization emphasis object may be generated and placed on the player who has possession of the play object. The visual emphasis object may have a size proportional to height of a bounding box associated with the player having the possession of the play object.

## Claims

### Claim 1

A computer-implemented method comprising:
receiving a video clip associated with a sporting event in which a plurality of players are participating using a playing field, the sporting event also having a play object associated therewith;
detecting people included in a frame of the video clip;
detecting players from among the people included in the frame of the video clip;
identifying players who are on the playing field from among the detected players;
associating each of the players identified to be on the playing field with a rectangular bounding box that provides an outline of each of the players as the players appear in the frame of the video clip;
receiving data identifying a player from the players on the playing field to have possession of the play object;
generating a visualization emphasis object having a size proportional to a height of the bounding box associated with the player having possession of the play object;
positioning the visualization emphasis object at a center of a base of the bounding box associated with the player having possession of the play object;
blending the visualization emphasis object with the frame to generate an updated video clip, wherein the blending of the visualization emphasis object with the frame is performed using perspective transformation, wherein the updated video clip includes one or more frames of the video clip; and
transmitting the updated video clip to a media presentation service to be offered as a replay option of the video clip.

### Claim 2 (depends on 1)

The method of claim 1, wherein the blending of the visualization emphasis object with the frame includes determining a color for the visualization emphasis object.

### Claim 3 (depends on 1)

The method of claim 1, wherein the positioning the visualization emphasis object is performed using field surface segmentation.

### Claim 4 (depends on 1)

The method of claim 1, wherein the visualization emphasis object is placed on a field ground plane.

### Claim 5

A computer-implemented method comprising:
receiving a video clip associated with a sporting event in which a plurality of players are participating using a playing field, the sporting event having a play object associated therewith;
detecting people included in a frame of the video clip;
detecting players from among the people included in the frame of the video clip;
identifying players who are on the playing field from the detected players;
associating each of the players identified to be on the playing field with a rectangular bounding box that provides an outline of each of the players as the players appear in the frame of the video clip;
receiving data identifying which player from among the players on the playing field has possession of the play object in the frame of the video clip;
generating a visualization emphasis object having a size proportional to a height of the bounding box associated with the player having possession of the play object;
positioning the visualization emphasis object at a center of a base of the bounding box associated with the player having possession of the play object; and
blending the visualization emphasis object with the frame to generate an updated video clip, wherein the blending of the visualization emphasis object with the frame is performed using perspective transformation, wherein the updated video clip includes one or more frames of the video clip.

### Claim 6 (depends on 5)

The method of claim 5, further comprising:
transmitting the updated video clip to a media presentation service to be offered as a playback option.

### Claim 7 (depends on 5)

The method of claim 5, wherein the blending of the visualization emphasis object with the frame includes determining a color for the visualization emphasis object to enable the visualization emphasis object to be visible relative to a surface of the playing field.

### Claim 8 (depends on 7)

The method of claim 7, wherein positioning of the visualization emphasis object on the playing field is performed using field surface segmentation.

### Claim 9 (depends on 5)

The method of claim 5, wherein the visualization emphasis object is placed on a field ground plane.

### Claim 10 (depends on 5)

The method of claim 5, wherein the visualization emphasis object is not displayed in one or more frames of the updated video clip.

### Claim 11 (depends on 5)

The method of claim 5, wherein a portion of the visualization emphasis object is occluded by players, officials, objects, or any combination thereof on the playing field.

### Claim 12 (depends on 5)

The method of claim 5, further comprising identifying which player from the players on the playing field has possession of the play object in the frame.

### Claim 13

A system comprising:
memory configured to store computer-executable instructions; and
at least one computer processor configured to access the memory and execute the computer-executable instructions to:
receive a video clip associated with a sporting event participated by a plurality of players using a playing field and sharing a play object;
detect people included in a frame of the video clip;
detect players from among the people included in the frame of the video clip;
identify players who are on the playing field from the detected players;
associate each of the players identified to be on the playing field with a rectangular bounding box that provides an outline of each of the players as the players appear in the frame of the video clip;
receive data identifying which player from the players on the playing field has possession of the play object in the frame of the video clip;
generating a visualization emphasis object having a size proportional to a height of the bounding box associated with the player having possession of the play object;
positioning the visualization emphasis object at a center of a base of the bounding box associated with the player having possession of the play object;
and
blend the visualization emphasis object with the frame to generate an updated video clip, wherein blending of the visualization emphasis object with the frame comprises a perspective transformation of the visualization emphasis object, wherein the updated video clip includes one or more frames of the video clip.

### Claim 14 (depends on 13)

The system of claim 13, further comprising instructions to:
transmit the updated video clip to a media presentation service to be offered as a playback option.

### Claim 15 (depends on 13)

The system of claim 13, wherein the instructions to blend the visualization emphasis object with the frame includes instructions to determine a color for the visualization emphasis object to enable the visualization emphasis object to be visible with a surface of the playing field.

### Claim 16 (depends on 15)

The system of claim 15, wherein field surface segmentation is used to determine a location on the playing field to place the visual emphasis object.

### Claim 17 (depends on 13)

The system of claim 13, wherein the visualization emphasis object is placed on a field ground plane.

### Claim 18 (depends on 13)

The system of claim 13, wherein the visualization emphasis object is not displayed in one or more frames of the updated video clip.

### Claim 19 (depends on 13)

The system of claim 13, wherein a portion of the visualization emphasis object is occluded by players, officials, objects, or any combination thereof on the playing field.

### Claim 20 (depends on 13)

The system of claim 13, wherein the computer-executable instructions include further instructions to identify which player from the players on the playing field has possession of the play object in the frame.
