# US 2024/0205519 A1 · Intelligent media production for enhanced streaming of a live sporting event

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0205519 A1
- Document ID: US20240205519A1
- Status: Published application
- Kind: A1
- Application number: 18/083,183
- Filed: 2022-12-16
- Published: 2024-06-20
- Earliest claimed: 2022-12-16
- Assignees: Intelicaster, LLC
- Applicants: Intelicaster, LLC
- Inventors: MATT VAN BERGEN; PAUL MICHELOTTI; RANDON MORFORD; TIM COLEMAN
- Web page: https://patentgrep.com/patent/US20240205519A1

## CPC

- H04N 21/8547: involving timestamps for synchronizing content
- H04N 21/2187: Live feed
- H04N 21/23106: {involving caching operations (prefetching while addressing of a memory level in which the access to the desired data or data block requires associative addressing means within memory systems or architectures G06F12/0862; caching at an intermediate stage in a data network H04L67/568)}
- H04N 21/23418: {involving operations for analysing video streams, e.g. detecting features or characteristics (television picture signal circuitry for scene change detection H04N5/147; filtering for image enhancement G06T5/00; methods or arrangements for recognising scenes G06V20/00; arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59)}
- H04N 21/2368: Multiplexing of audio and video streams
- H04N 21/812: {involving advertisement data (advertising per se G06Q30/02)}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

For intelligent sportscast production for enhanced streaming of a live sporting event, a method includes selecting a production route model with predetermined conditions that indicate values for initial sportscast velocity vectors for composing an ordered stream of synthesized audio segments and/or synthesized video segments for a live sporting event occurring at a sports venue based at least on event type, game state, hosting team, and sportscast output type; caching sets of live event observations for generating production cues during the live sporting event to be composed as synthesized audio segments and/or synthesized video segments, the live event observations derived from scoreboard data obtained from: a live scoreboard data feed associated with an onsite scoreboard; and/or machine recognition of game state data from a live video feed captured by an onsite camera; and producing adjusted synthesized content velocity vectors based on the live event observations and/or a current game state.

## Claims

### Claim 1

A method comprising:
determining, for producing a sportscast media stream of a live sporting event, a production route model with target sportscast velocity vectors corresponding to a plurality of waypoints that indicate a change in content direction and/or content magnitude for a sportscast segment of the live sporting event;
generating production cues for producing sportscast content comprising dynamically ordered audio segments and/or video segments that are synthesized based on live event observations and/or precommitted content, wherein the production cues are selected from cached groups of candidate cues selected as the production cues based on which candidate cues most closely align with one or more direction elements and magnitude elements of the target sportscast velocity vectors for a current waypoint of the plurality of waypoints;
composing the sportscast media stream that comprises the dynamically ordered audio segments and/or video segments that are produced from the production cues integrated with a live video feed and/or a live audio feed captured at the live sporting event; and
streaming the sportscast media stream to one or more streaming media receivers.

### Claim 2 (depends on 1)

The method of claim 1, wherein determining the production route model comprises determining initial sportscast velocity vectors for composing an ordered media stream of synthesized audio segments and/or synthesized video segments for the live sporting event occurring at a sports venue based at least in part on an event type for the live sporting event, a current game state, and a type of the sportscast media stream to be output.

### Claim 3 (depends on 1)

The method of claim 1, wherein at least a first portion of the live event observations are derived from:
a live scoreboard data feed associated with an onsite scoreboard; and/or
machine recognition of scoreboard data from the live video feed captured by an onsite camera.

### Claim 4 (depends on 1)

The method of claim 1, wherein at least a second portion of the live event observations are derived from a combination of:
a live scoreboard data feed associated with an onsite scoreboard; and
machine recognition of non-scoreboard data from the live video feed captured by an onsite camera and/or microphone.

### Claim 5 (depends on 1)

The method of claim 1, further comprising:
organizing one or more live event observations based on time of occurrence;
producing validated live event observations by performing one or more of:
checking that the occurrence of the one or more live event observations is consistent with the occurrence of one or more prior validated live event observations,
verifying that the occurrence of the one or more live event observations is consistent with results of machine recognition of non-scoreboard data from the live video feed captured by an onsite camera and/or microphone,
checking the live event observations for compliance with a set of predetermined rules for a selected type of the live sporting event, and
combinations thereof; and
including the validated live event observations in the cached groups of the candidate cues indicating one or more direction elements and/or magnitude elements of the target sportscast velocity vectors from which the sportscast content is selected.

### Claim 6 (depends on 1)

The method of claim 1, wherein the target sportscast velocity vectors corresponding to the plurality of waypoints individually comprise:
the one or more direction elements that indicate to what extent sportscast content corresponding to current game state parameters within the production route model is configured to be selected, the direction elements selected from inform content, insight content, entertain content, and combinations thereof; and
one or more magnitude elements that indicate a relative selection priority for content corresponding respectively to the one or more direction elements.

### Claim 7 (depends on 1)

The method of claim 1, further comprising modifying timing related parameters of selected live event observations for generating the production cues by performing on the selected live event observations, one or more editing operations selected from splitting, combining, truncating, deleting, lengthening, shortening, reordering, postponing, resuming, and/or combinations thereof.

### Claim 8 (depends on 7)

The method of claim 7, wherein reordering the selected live event observations comprises ordering the production cues in an order that is different from a temporally linear order indicated by timestamps of corresponding live event observations.

### Claim 9 (depends on 1)

The method of claim 1, further comprising:
determining a score for the candidate cues within the cached groups for the one or more direction elements of the target sportscast velocity vectors.

### Claim 10 (depends on 9)

The method of claim 9, further comprising searching the cached groups of the candidate cues to select content for a best fit proximate production cue based on alignment of the content with current waypoint sportscast velocity vectors.

### Claim 11 (depends on 1)

The method of claim 1, further comprising sending synthesized commentary text within production cues designated for vocalization to be vocalized for inclusion in at least a portion of the dynamically ordered audio segments.

### Claim 12 (depends on 1)

The method of claim 1, wherein the production cues further comprise instructions for accessing pre-generated audio segments and/or video segments.

### Claim 13 (depends on 1)

The method of claim 1, further comprising, modifying and/or generating precommitted content during the live sporting event, the precommitted content selected from commercial content and/or community interest content based at least in part on information derived from one or more live event observations.

### Claim 14 (depends on 13)

The method of claim 13, wherein the precommitted content is retrieved from an ad management system based on the production cues selected to take precedence over sportscast velocity vectors for a current waypoint.

### Claim 15 (depends on 1)

The method of claim 1, further comprising composing the sportscast media stream by integrating the dynamically ordered audio segments and/or video segments that are produced from the production cues with the live video feed and/or the live audio feed at synchronization points determined based on target sportscast velocity vectors for a current waypoint.

### Claim 16 (depends on 1)

The method of claim 1, further comprising streaming the sportscast media stream to one or more streaming receivers during the live sporting event.

### Claim 17 (depends on 16)

The method of claim 16, further comprising streaming, during the live sporting event, an audio-only version of the sportscast media stream.

### Claim 18 (depends on 17)

The method of claim 17, further comprising streaming, during the live sporting event, at least a portion of the sportscast media stream to one or more audio devices and/or video devices at the live sporting event.

### Claim 19

A program product comprising a non-transitory computer readable storage medium storing code, the code being configured to be executable by a processor to perform operations comprising:
determining a production route model with waypoint sportscast velocity vectors for composing an ordered stream of sportscast audio segments and/or sportscast video segments for a live sporting event occurring at a sports venue based at least on event type, game state, hosting team, and sportscast output type;
caching groups of live event observations for generating production cues during the live sporting event to be composed as sportscast audio content segments and/or sportscast video content segments, the groups of the live event observations derived from scoreboard data obtained from:
a live scoreboard data feed associated with an onsite scoreboard, and/or
machine recognition of game state data from a live video feed captured by an onsite camera;
determining the production cues to be generated from selected live event observations that are selected from the groups of the live event observations based on comparing current waypoint sportscast velocity vectors with current candidate cues;
generating synthesized video content segments based on one or more of the production cues; and
generating synthesized audio content segments from commentary text within selected production cues designated for vocalization.

### Claim 20

A system comprising:
an intelligent sportscast production engine for dynamically producing a streaming sportscast of a live sporting event occurring onsite at a sports venue, the intelligent sportscast production engine comprising:
one or more observation connectors configured to output a plurality of live event observations derived from one or more live data feeds captured onsite at the sports venue, the one or more live data feeds comprising:
a live scoreboard data feed associated with an onsite scoreboard, and/or
machine recognition of game state data from a live video feed captured by an onsite camera;
an observation preprocessor configured to produce validated live event observations by performing preprocessing operations on the plurality of live event observations, the preprocessing operations comprising: categorizing live event observations by observation type; ordering event observations based at least in part on observation time stamps; filtering event observations, and combinations thereof;
a production route planner configured to select and determine an order of production cues comprising synthesized audiovisual content segments based on current waypoint sportscast velocity vectors and live action to sportscast latency, wherein the production route planner is further configured to cause vocalization of synthesized commentary text within selected production cues designated for vocalization; and
a media composer configured to output a sportscast media stream by integrating the live video feed and/or a live audio feed with the synthesized audiovisual content segments in the order determined by the production route planner;
wherein at least a portion of the observation connectors, the observation preprocessor, the production route planner, and the media composer comprises one or more of a set of hardware circuits, a set of programmable hardware devices, and executable code stored on a set of non-transitory computer-readable storage media.
