# US 10,484,675 B2 · Systems and methods for presenting content

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,484,675 B2
- Document ID: US10484675B2
- Status: Granted
- Kind: B2
- Application number: 15/488,484
- Filed: 2017-04-16
- Published: 2018-10-18
- Granted: 2019-11-19
- Earliest claimed: 2017-04-16
- Assignees: Facebook, Inc.
- Applicants: Facebook, Inc.
- Inventors: Chien-Nan Chen
- Web page: https://patentgrep.com/patent/US10484675B2

## CPC

- H04N 13/366: using viewer tracking
- H04N 21/23412: {for generating or manipulating the scene composition of objects, e.g. MPEG-4 objects}
- H04N 21/25891: {being end-user preferences (retrieval of video data in a video database based on user preferences G06F16/739; arrangements for recognizing users' preferences H04H60/46; user profiles in network data switching protocols H04L67/306; processing of user preferences or user profiles in wireless networks H04W8/18)}
- H04N 23/698: for achieving an enlarged field of view, e.g. panoramic image capture
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Systems, methods, and non-transitory computer-readable media can determine a first position corresponding to a user focal point prior to presenting a given frame of a content item. A landscape representation of the given frame is determined. The landscape representation describes the respective popularity of one or more regions in the frame as a topology. A second position corresponding to the user focal point is determined based at least in part on the landscape representation and the first position. The second position is predicted to be the position of the user focal point when presenting the given frame.

## Claims

### Claim 1

A computer-implemented method comprising:
determining, by a computing system, a first position corresponding to a user focal point prior to presenting a given frame of a content item;
determining, by the computing system, a landscape representation of the given frame, wherein the landscape representation describes the respective popularity of one or more regions in the frame as a topology, wherein popular regions in the frame are represented in the landscape representation as valleys, and wherein unpopular regions in the frame are represented in the landscape representation as peaks; and
determining, by the computing system, a second position corresponding to the user focal point based at least in part on the landscape representation and the first position, wherein the second position is predicted to be the position of the user focal point when presenting the given frame.

### Claim 2 (depends on 1)

The computer-implemented method of claim 1, wherein the user focal point corresponds to a direction of a viewport through which the content item is presented.

### Claim 3 (depends on 1)

The computer-implemented method of claim 1, wherein determining the landscape representation of the given frame further comprises:
obtaining, by the computing system, heat map data corresponding to the given frame, the heat map data representing user view activity for regions in the frame; and
generating, by the computing system, the landscape representation based at least in part on the heat map data.

### Claim 4 (depends on 3)

The computer-implemented method of claim 3, wherein the depth of a valley corresponding to a given popular region is determined based on a number of user views corresponding to the given popular region.

### Claim 5 (depends on 3)

The computer-implemented method of claim 3, wherein the height of a peak corresponding to a given unpopular region is determined based on a number of user views corresponding to the given unpopular region.

### Claim 6 (depends on 1)

The computer-implemented method of claim 1, wherein determining the second position corresponding to the user focal point based at least in part on the landscape representation and the first position further comprises:
applying, by the computing system, a simulation using the landscape representation and a particle placed in the landscape representation at the first position, wherein the simulation causes the particle to move toward a given region in the landscape representation.

### Claim 7 (depends on 6)

The computer-implemented method of claim 6, wherein the simulation involves applying a simulated gravitational force to the particle.

### Claim 8 (depends on 6)

The computer-implemented method of claim 6, wherein the simulation involves applying an initial velocity and acceleration to the particle, the initial velocity and acceleration being determined based at least in part on a velocity and acceleration corresponding to the user focal point prior to presenting the given frame.

### Claim 9 (depends on 8)

The computer-implemented method of claim 8, wherein the velocity and acceleration of the user focal point is determined based at least in part on movement of a computing device through which the content item is being presented.

### Claim 10 (depends on 1)

The computer-implemented method of claim 1, wherein the content item is a virtual reality content item created by stitching together a set of video streams that capture one or more scenes.

### Claim 11

A system comprising:
at least one processor; and
a memory storing instructions that, when executed by the at least one processor, cause the system to perform:
determining a first position corresponding to a user focal point prior to presenting a given frame of a content item;
determining a landscape representation of the given frame, wherein the landscape representation describes the respective popularity of one or more regions in the frame as a topology, wherein popular regions in the frame are represented in the landscape representation as valleys, and wherein unpopular regions in the frame are represented in the landscape representation as peaks; and
determining a second position corresponding to the user focal point based at least in part on the landscape representation and the first position, wherein the second position is predicted to be the position of the user focal point when presenting the given frame.

### Claim 12 (depends on 11)

The system of claim 11, wherein the user focal point corresponds to a direction of a viewport through which the content item is presented.

### Claim 13 (depends on 11)

The system of claim 11, wherein determining the landscape representation of the given frame further causes the system to perform:
obtaining heat map data corresponding to the given frame, the heat map data representing user view activity for regions in the frame; and
generating the landscape representation based at least in part on the heat map data.

### Claim 14 (depends on 13)

The system of claim 13, wherein the depth of a valley corresponding to a given popular region is determined based on a number of user views corresponding to the given popular region.

### Claim 15 (depends on 13)

The system of claim 13, wherein the height of a peak corresponding to a given unpopular region is determined based on a number of user views corresponding to the given unpopular region.

### Claim 16

A non-transitory computer-readable storage medium including instructions that, when executed by at least one processor of a computing system, cause the computing system to perform a method comprising:
determining a first position corresponding to a user focal point prior to presenting a given frame of a content item;
determining a landscape representation of the given frame, wherein the landscape representation describes the respective popularity of one or more regions in the frame as a topology, wherein popular regions in the frame are represented in the landscape representation as valleys, and wherein unpopular regions in the frame are represented in the landscape representation as peaks; and
determining a second position corresponding to the user focal point based at least in part on the landscape representation and the first position, wherein the second position is predicted to be the position of the user focal point when presenting the given frame.

### Claim 17 (depends on 16)

The non-transitory computer-readable storage medium of claim 16, wherein the user focal point corresponds to a direction of a viewport through which the content item is presented.

### Claim 18 (depends on 16)

The non-transitory computer-readable storage medium of claim 16, wherein determining the landscape representation of the given frame further causes the computing system to perform:
obtaining heat map data corresponding to the given frame, the heat map data representing user view activity for regions in the frame; and
generating the landscape representation based at least in part on the heat map data.

### Claim 19 (depends on 18)

The non-transitory computer-readable storage medium of claim 18, wherein the depth of a valley corresponding to a given popular region is determined based on a number of user views corresponding to the given popular region.

### Claim 20 (depends on 18)

The non-transitory computer-readable storage medium of claim 18, wherein the height of a peak corresponding to a given unpopular region is determined based on a number of user views corresponding to the given unpopular region.
