# US 2022/0070502 A1 · Methods and Systems for Interactive Content Delivery In Connection With a Live Video Stream

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0070502 A1
- Document ID: US20220070502A1
- Status: Published application
- Kind: A1
- Application number: 17/506,919
- Filed: 2021-10-21
- Published: 2022-03-03
- Earliest claimed: 2020-08-31
- Assignees: Verizon Patent and Licensing Inc.
- Applicants: Verizon Patent and Licensing Inc.
- Inventors: Mohammad Raheel Khalid; William Robert Davey; Vito Joseph Messina; Carl L. Keifer, III; Oliver S. Castaneda; Scott David Brown
- Web page: https://patentgrep.com/patent/US20220070502A1

## CPC

- H04N 21/2187: Live feed
- H04N 21/23418: {involving operations for analysing video streams, e.g. detecting features or characteristics (television picture signal circuitry for scene change detection H04N5/147; filtering for image enhancement G06T5/00; methods or arrangements for recognising scenes G06V20/00; arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59)}
- H04N 21/4781: {Games}
- H04N 21/643: Communication protocols {(network streaming protocols, e.g. real-time transport protocol [RTP] or real-time control protocol [RTCP], H04L65/65)}
- H04N 21/64784: {Data processing by the network (data processing in packet switching systems H04L12/56; flow control in packet networks H04L47/10; intermediate storage or scheduling H04L49/90; provisioning of proxy services in data packet switching networks H04L67/56)}
- H04N 21/8166: {involving executable data, e.g. software (arrangements for executing specific programs G06F9/44; broadcasting computer programmes in broadcast systems H04H20/91; involving the movement of software or configuration parameters H04L67/34)}
- H04N 21/8545: for generating interactive applications
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

An illustrative interactive content provider system transmits a live video stream to an interactive content player device, and, during the transmitting of the live video stream, provides an executable data object to the interactive content player device. The executable data object includes an interactive content instance configured to be presented within a 3D virtual playing area that bounds at least one virtual object of the interactive content instance. The interactive content provider system directs the interactive content player device to execute the executable data object by overlaying the 3D virtual playing area of the interactive content instance onto a presentation of the live video stream. Corresponding methods and systems are disclosed for both the interactive content provider system and the interactive content player device.

## Claims

### Claim 1

A method comprising:
transmitting, by an interactive content provider system, a live video stream to an interactive content player device;
providing, by the interactive content provider system and during the transmitting of the live video stream, an executable data object to the interactive content player device, the executable data object including an interactive content instance configured to be presented within a 3D virtual playing area that bounds at least one virtual object of the interactive content instance; and
directing, by the interactive content provider system, the interactive content player device to execute the executable data object by overlaying the 3D virtual playing area of the interactive content instance onto a presentation of the live video stream.

### Claim 2 (depends on 1)

The method of claim 1, wherein:
the interactive content instance includes a set of virtual objects comprising the at least one virtual object and comprising a virtual floor object that forms a lower boundary of the 3D virtual playing area to keep the at least one virtual object above the virtual floor object; and
the virtual floor object is distinct from a floor plane depicted in the live video stream when the 3D virtual playing area is overlaid onto the presentation of the live video stream.

### Claim 3 (depends on 1)

The method of claim 1, wherein:
the interactive content instance includes a set of virtual objects comprising the at least one virtual object and comprising a virtual floor object and one or more virtual wall objects configured as boundaries to keep the at least one virtual object within the 3D virtual playing area; and
the one or more virtual wall objects are invisible and extend upward from the virtual floor object.

### Claim 4 (depends on 1)

The method of claim 1, wherein:
the at least one virtual object includes a virtual ball object configured to be thrown within the 3D virtual playing area by a user of the interactive content player device;
the interactive content instance includes a set of virtual objects comprising the virtual ball object and comprising a virtual floor object and one or more virtual wall objects configured as boundaries to keep the virtual ball object within the 3D virtual playing area; and
when the user virtually throws the virtual ball object within the 3D virtual playing area, the virtual ball object is configured to bounce off the virtual floor object and the one or more virtual wall objects to remain within the 3D virtual playing area.

### Claim 5 (depends on 1)

The method of claim 1, wherein:
the interactive content instance is an interactive game to be played by a user of the interactive content player device;
the interactive game allows the user to attempt, by way of interactive input provided by the user, to direct the at least one virtual object to a target; and
the interactive game provides an indication of whether the user successfully directed the at least one virtual object to the target.

### Claim 6 (depends on 1)

The method of claim 1, further comprising:
transmitting, by the interactive content provider system, a first event marker in the live video stream, the first event marker configured to direct the interactive content player device to access the executable data object provided by the interactive content provider system; and
transmitting, by the interactive content provider system while the interactive content player device is executing the executable data object, a second event marker in the live video stream, the second event marker configured to direct the interactive content player device to discontinue the executing of the executable data object.

### Claim 7 (depends on 6)

The method of claim 6, wherein the second event marker directs the interactive content player device to perform the discontinuance of the executing of the executable data object at a later time, the discontinuance at the later time including:
monitoring, by the interactive content player device in response to the detecting of the second event marker and as the executing of the executable data object persists, for an indication by a user that the executing of the executable data object is to be discontinued;
detecting, by the interactive content player device during the monitoring, the indication by the user that the executing of the executable data object is to be discontinued; and
transitioning, by the interactive content player device in response to the detecting of the indication by the user, from the overlaying of the 3D virtual playing area onto the presentation of the live video stream to presenting the live video stream without the overlaying of the 3D virtual playing area.

### Claim 8 (depends on 1)

The method of claim 1, wherein the providing of the executable data object includes at least one of:
providing at least some data representative of the interactive content instance within data embedded in the live video stream to allow the interactive content player device to at least partially load the interactive content instance from the live video stream; or
providing a link within the live video stream to allow the interactive content player device to retrieve at least some data representative of the interactive content instance from an asset server to which the link is directed.

### Claim 9 (depends on 1)

The method of claim 1, wherein the live video stream is an HTTP live stream (HLS) video stream representing a real-time representation of a real-world event taking place at a real-world scene.

### Claim 10 (depends on 1)

The method of claim 1, wherein the providing of the executable data object includes providing the executable data object in a flattened executable form preconfigured for storage in memory of the interactive content player device during the executing of the executable data object.

### Claim 11 (depends on 1)

The method of claim 1, wherein the directing of the interactive content player device to execute the executable data object includes directing the interactive content player device to execute the interactive content instance based on the executable data object and in accordance with interactive input provided by a user of the interactive content player device.

### Claim 12

A system comprising:
a memory storing instructions; and
a processor communicatively coupled to the memory and configured to execute the instructions to:
transmit a live video stream to an interactive content player device;
provide, during the transmitting of the live video stream, an executable data object to the interactive content player device, the executable data object including an interactive content instance configured to be presented within a 3D virtual playing area that bounds at least one virtual object of the interactive content instance; and
direct the interactive content player device to execute the executable data object by overlaying the 3D virtual playing area of the interactive content instance onto a presentation of the live video stream.

### Claim 13 (depends on 12)

The system of claim 12, wherein:
the interactive content instance includes a set of virtual objects comprising the at least one virtual object and comprising a virtual floor object that forms a lower boundary of the 3D virtual playing area to keep the at least one virtual object above the virtual floor object; and
the virtual floor object is distinct from a floor plane depicted in the live video stream when the 3D virtual playing area is overlaid onto the presentation of the live video stream.

### Claim 14 (depends on 12)

The system of claim 12, wherein:
the interactive content instance includes a set of virtual objects comprising the at least one virtual object and comprising a virtual floor object and one or more virtual wall objects configured as boundaries to keep the at least one virtual object within the 3D virtual playing area; and
the one or more virtual wall objects are invisible and extend upward from the virtual floor object.

### Claim 15 (depends on 12)

The system of claim 12, wherein:
the at least one virtual object includes a virtual ball object configured to be thrown within the 3D virtual playing area by a user of the interactive content player device;
the interactive content instance includes a set of virtual objects comprising the virtual ball object and comprising a virtual floor object and one or more virtual wall objects configured as boundaries to keep the virtual ball object within the 3D virtual playing area; and
when the user virtually throws the virtual ball object within the 3D virtual playing area, the virtual ball object is configured to bounce off the virtual floor object and the one or more virtual wall objects to remain within the 3D virtual playing area.

### Claim 16 (depends on 12)

The system of claim 12, wherein:
the interactive content instance is an interactive game to be played by a user of the interactive content player device;
the interactive game allows the user to attempt, by way of interactive input provided by the user, to direct the at least one virtual object to a target; and
the interactive game provides an indication of whether the user successfully directed the at least one virtual object to the target.

### Claim 17 (depends on 12)

The system of claim 12, wherein the processor is further configured to execute the instructions to:
transmit a first event marker in the live video stream, the first event marker configured to direct the interactive content player device to access the executable data object provided by the system; and
transmit, while the interactive content player device is executing the executable data object, a second event marker in the live video stream, the second event marker configured to direct the interactive content player device to discontinue the executing of the executable data object.

### Claim 18 (depends on 17)

The system of claim 17, wherein the second event marker directs the interactive content player device to perform the discontinuance of the executing of the executable data object at a later time, the discontinuance at the later time including:
monitoring, by the interactive content player device in response to the detecting of the second event marker and as the executing of the executable data object persists, for an indication by a user that the executing of the executable data object is to be discontinued;
detecting, by the interactive content player device during the monitoring, the indication by the user that the executing of the executable data object is to be discontinued; and
transitioning, by the interactive content player device in response to the detecting of the indication by the user, from the overlaying of the 3D virtual playing area onto the presentation of the live video stream to presenting the live video stream without the overlaying of the 3D virtual playing area.

### Claim 19 (depends on 12)

The system of claim 12, wherein the providing of the executable data object includes at least one of:
providing at least some data representative of the interactive content instance within data embedded in the live video stream to allow the interactive content player device to at least partially load the interactive content instance from the live video stream; or providing a link within the live video stream to allow the interactive content player device to retrieve at least some data representative of the interactive content instance from an asset server to which the link is directed.

### Claim 20

A non-transitory computer-readable medium storing instructions that, when executed, direct a processor of a computing device to:
transmit a live video stream to an interactive content player device;
provide, during the transmitting of the live video stream, an executable data object to the interactive content player device, the executable data object including an interactive content instance configured to be presented within a 3D virtual playing area that bounds at least one virtual object of the interactive content instance; and
direct the interactive content player device to execute the executable data object by overlaying the 3D virtual playing area of the interactive content instance onto a presentation of the live video stream.
