# US 12,015,819 B2 · Systems and methods for minimizing obstruction of a media asset by an overlay by predicting a path of movement of an object of interest of the media asset and avoiding placement of the overlay in the path of movement

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,015,819 B2
- Document ID: US12015819B2
- Status: Granted
- Kind: B2
- Application number: 18/108,971
- Filed: 2023-02-13
- Published: 2023-07-27
- Granted: 2024-06-18
- Earliest claimed: 2021-06-25
- Assignees: Rovi Guides, Inc.
- Applicants: Rovi Guides, Inc.
- Inventors: Vikram Makam Gupta; Vishwas Sharadanagar Panchaksharaiah
- Web page: https://patentgrep.com/patent/US12015819B2

## CPC

- H04N 21/4316: {for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window}
- H04N 21/2187: Live feed
- H04N 21/4312: {involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations}
- H04N 21/44008: {involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream (arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59)}
- H04N 21/4532: {involving end-user characteristics, e.g. viewer profile, preferences (monitoring of user activities for profile generation for accessing a video database G06F16/739; user profiles in network data switching protocols H04L67/306; processing of user preferences or user profiles in wireless networks H04W8/18)}
- H04N 21/466: Learning process for intelligent management, e.g. learning user preferences for recommending movies {(services using the results of monitoring in broadcast systems H04H60/61)}
- H04N 21/8126: {involving additional data, e.g. news, sports, stocks, weather forecasts}
- H04N 21/8133: {specifically related to the content, e.g. biography of the actors in a movie, detailed information about an article seen in a video programme}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Systems and methods are provided herein for minimizing obstruction of a media asset by an overlay by predicting a path of movement of an object of interest of the media asset and avoiding placement of the overlay in the path of movement. To this end, a media guidance application may detect an object of interest in a first frame of a media asset, and may determine a determining a first location of the object in the first frame and a second location of the object of interest in a second frame. The media guidance application may calculate, based on the first location and the second location, a projected location of the object of interest in a third frame of the media asset, and may generate for display an overlay in a location that does not overlap with any of the first location, the second location, and the projected location.

## Claims

### Claim 1

A method comprising:
detecting an object of interest in a media asset;
determining a first location of the object of interest in a first frame and a second location of the object of interest in a second frame of the media asset;
determining, based on the first location and the second location, a projected path of the object of interest in a portion of the media asset that is generated for display after the first frame and the second frame;
determining an estimated time for the object of interest to traverse the projected path; and
generating for display an overlay on top of the portion of the media asset such that the overlay does not cover the projected path during the estimated time for the object of interest to traverse the projected path.

### Claim 2 (depends on 1)

The method of claim 1, further comprising:
detecting a plurality of objects in addition to the object of interest in the media asset; and
performing the generating for display of the overlay within a region of the portion of the media asset further based on determining that the plurality of objects are not present in the region.

### Claim 3 (depends on 2)

The method of claim 2, further comprising:
determining a size of the overlay;
identifying a region in the second frame corresponding to the size of the overlay that is unchanged in the second frame as compared to the first frame; and
performing the generating for display of the overlay within the region.

### Claim 4 (depends on 1)

The method of claim 1, further comprising:
determining that an additional object is approaching the object of interest in the media asset and is likely to impact the projected path;
determining an updated projected path based on determining that the additional object is approaching the object of interest in the media asset and is likely to impact the projected path of the object of interest; and
generating for display the overlay based on the updated projected path.

### Claim 5 (depends on 1)

The method of claim 1, wherein determining the updated projected path comprises:
determining a first velocity of the object of interest;
determining a second velocity of the additional object; and
determining the updated projected path based on the first velocity and the second velocity.

### Claim 6 (depends on 1)

The method of claim 1, further comprising:
determining that the object of interest has deviated from the projected path; and
in response to determining that the object of interest has deviated from the projected path, ceasing the generating for display of the overlay on top of the media asset.

### Claim 7 (depends on 1)

The method of claim 1, wherein determining the projected path further comprises:
comparing the first location to the second location to determine a distance between the first location and the second location and a direction in which the object of interest is traveling;
comparing a time stamp of the first frame to a time stamp of the second frame to determine a time difference between the times at which the first frame and the second frame were generated for display;
determining a velocity of the object of interest based on the distance, the direction, and the time difference; and
determining the projected path based on the velocity.

### Claim 8 (depends on 1)

The method of claim 1, further comprising:
determining a type of the object of interest; and
determining the projected path of the object of interest based at least in part on the determined type.

### Claim 9 (depends on 1)

The method of claim 1, further comprising:
determining a type of the media asset; and
determining the projected path of the object of interest based at least in part on the determined type.

### Claim 10 (depends on 1)

The method of claim 1, further comprising:
determining a size of the overlay based at least in part on the projected path of the object of interest.

### Claim 11

A system comprising:
memory circuitry;
control circuitry configured to:
detect an object of interest in a media asset;
determine a first location of the object of interest in a first frame and a second location of the object of interest in a second frame of the media asset, wherein the first location and the second location are stored in the memory circuitry;
determine, based on the first location and the second location, a projected path of the object of interest in a portion of the media asset that is generated for display after the first frame and the second frame;
determine an estimated time for the object of interest to traverse the projected path; and
generate for display an overlay on top of the portion of the media asset such that the overlay does not cover the projected path during the estimated time for the object of interest to traverse the projected path.

### Claim 12 (depends on 11)

The system of claim 11, wherein the control circuitry is further configured to:
detect a plurality of objects in addition to the object of interest in the media asset; and
perform the generating for display of the overlay within a region of the portion of the media asset further based on determining that the plurality of objects are not present in the region.

### Claim 13 (depends on 12)

The system of claim 12, wherein the control circuitry is further configured to:
determine a size of the overlay;
identify a region in the second frame corresponding to the size of the overlay that is unchanged in the second frame as compared to the first frame; and
perform the generating for display of the overlay within the region.

### Claim 14 (depends on 11)

The system of claim 11, wherein the control circuitry is further configured to:
determine that an additional object is approaching the object of interest in the media asset and is likely to impact the projected path;
determine an updated projected path based on determining that the additional object is approaching the object of interest in the media asset and is likely to impact the projected path of the object of interest; and
generate for display the overlay based on the updated projected path.

### Claim 15 (depends on 11)

The system of claim 11, wherein the control circuitry is further configured to determine the updated projected path by:
determining a first velocity of the object of interest;
determining a second velocity of the additional object; and
determining the updated projected path based on the first velocity and the second velocity.

### Claim 16 (depends on 11)

The system of claim 11, wherein the control circuitry is further configured to:
determine that the object of interest has deviated from the projected path; and
in response to determining that the object of interest has deviated from the projected path, cease the generating for display of the overlay on top of the media asset.

### Claim 17 (depends on 11)

The system of claim 11, wherein the control circuitry is further configured to determine the projected path by:
comparing the first location to the second location to determine a distance between the first location and the second location and a direction in which the object of interest is traveling;
comparing a time stamp of the first frame to a time stamp of the second frame to determine a time difference between the times at which the first frame and the second frame were generated for display;
determining a velocity of the object of interest based on the distance, the direction, and the time difference; and
determining the projected path based on the velocity.

### Claim 18 (depends on 11)

The system of claim 11, wherein the control circuitry is further configured to:
determine a type of the object of interest; and
determine the projected path of the object of interest based at least in part on the determined type.

### Claim 19 (depends on 11)

The system of claim 11, wherein the control circuitry is further configured to:
determine a type of the media asset; and
determine the projected path of the object of interest based at least in part on the determined type.

### Claim 20 (depends on 11)

The system of claim 11, wherein the control circuitry is further configured to:
determine a size of the overlay based at least in part on the projected path of the object of interest.
