# US 2023/0412544 A1 · Techniques for Optimizing the Display of Videos

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0412544 A1
- Document ID: US20230412544A1
- Status: Published application
- Kind: A1
- Application number: 18/228,592
- Filed: 2023-07-31
- Published: 2023-12-21
- Earliest claimed: 2013-02-13
- Inventors: Guy Ravine
- Web page: https://patentgrep.com/patent/US20230412544A1

## CPC

- H04L 51/10: Multimedia information
- G06F 1/1626: {with a single-body enclosure integrating a flat display, e.g. Personal Digital Assistants [PDAs]}
- G06F 1/1694: {the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer}
- G06F 3/0346: with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
- G06F 3/04845: for image manipulation, e.g. dragging, rotation, expansion or change of colour
- G06F 3/04883: for inputting data by handwriting, e.g. gesture or text
- G06V 10/25: Determination of region of interest [ROI] or a volume of interest [VOI]
- G06V 20/41: {Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items (segmenting video sequences G06V20/49)}
- H04L 12/1822: {Conducting the conference, e.g. admission, detection, selection or grouping of participants, correlating users to one or more conference sessions, prioritising transmission}
- H04L 65/60: Network streaming of media packets
- H04L 65/61: for supporting one-way streaming services, e.g. Internet radio
- G06F 2203/04806: Zoom, i.e. interaction techniques or interactors for controlling the zooming operation
- G06V 10/462: {Salient features, e.g. scale invariant feature transforms [SIFT]}
- G06V 40/16: Human faces, e.g. facial parts, sketches or expressions
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

The disclosed embodiments disclose techniques for optimizing the display of videos. During operation, a computing device receives a video stream to be displayed. The computing device determines a preferred orientation for the video stream, determines a present orientation for the computing device, and determines a mismatch between the preferred orientation and the present orientation. The computing device adjusts the video stream while displaying the video stream on the display. As the video stream plays, the computing device detects any rotation of the computing device, and if so, re-adjusts how the video stream is displayed.

## Claims

### Claim 1

A computer-implemented method for optimizing the display of videos, the method comprising:
receiving and displaying a video stream on the display of a computing device;
determining an area of emphasis in the video stream; and
adjusting the portion of the video stream being displayed to emphasize the area of emphasis while displaying the video stream.

### Claim 2 (depends on 1)

The computer-implemented method of claim 1,
wherein determining the area of emphasis further comprises using prominent activity analysis to continuously determine and analyze one or more areas of emphasis in the video stream; and
wherein adjusting the portion of the video stream being displayed to emphasize the area of emphasis further comprises adjusting the scale of the video stream to at least one of zoom in or zoom out the video stream to ensure that the area of emphasis is prominently displayed in the display.

### Claim 3 (depends on 2)

The computer-implemented method of claim 2, wherein adjusting the scale of the video stream to ensure that the area of emphasis is prominently displayed further comprises:
zooming out the video stream;
determining that zooming out the video stream would create a blank area of the display in which no portions of the video stream display; and
leveraging a context-aware image-resizing technique to seamlessly expand portions of the video stream to ensure that no blank areas are displayed in the zoomed-out video stream.

### Claim 4 (depends on 3)

The computer-implemented method of claim 3, wherein the context-aware image-resizing technique comprises a seam-carving technique that is applied in one dimension of the video stream to seamlessly expand that dimension of the video stream to minimize blank space on the display.

### Claim 5 (depends on 2)

The computer-implemented method of claim 2, wherein adjusting the scale of the video stream to ensure that the area of emphasis is prominently displayed further comprises:
zooming in on a portion of the video stream;
determining that zooming in the video stream would prevent the display of one or more visual details from one or more edges of the video stream display; and
leveraging a context-aware image-resizing technique to seamlessly compress visual portions of the video stream to ensure that the visual details from one or more edges remain displayed in the zoomed-in video stream.

### Claim 6 (depends on 2)

The computer-implemented method of claim 2, wherein the method further comprises:
determining a preferred orientation for the video stream, wherein the preferred orientation is different from a present orientation for the computing device;
detecting that the computing device is being rotated from the present orientation and incrementally counter-rotating the displaying video stream, as it continues to play, the number of degrees in the opposite direction from which the computing device has rotated to ensure that the video stream remains at a constant viewing orientation from the perspective of a user of the computing device who is viewing the computing device while the computing device rotates; and
wherein adjusting the portion of the video stream being displayed to focus on the area of emphasis comprises focusing on displaying the determined areas of emphasis before, as, and after the computing device rotates.

### Claim 7 (depends on 6)

The computer-implemented method of claim 6, wherein using prominent activity analysis further comprises:
detecting one or more active faces in the video stream;
ensuring that the active faces in the video stream are featured in the portion of the video stream that is displaying on the display before, as, and after the computing device rotates.

### Claim 8 (depends on 7)

The computer-implemented method of claim 7, wherein adjusting the portion of the video stream being displayed to emphasize the area of emphasis comprises zooming in and focusing on the one or more active faces in the video stream as the computing device and the displayed video stream rotate.

### Claim 9 (depends on 8)

The computer-implemented method of claim 8, wherein ensuring that the active faces in the video stream are featured in the portion of the video further comprises not fully zooming in the video stream to ensure that all of the active faces in the video stream remain visible in the display as the video stream is rotated and filling in any blank areas that arise in the video stream due to rotation effects using context-aware image-resizing techniques.

### Claim 10 (depends on 9)

The computer-implemented method of claim 9,
wherein the video stream can be displayed at any arbitrary angle with respect to the display;
wherein incrementally rotating the displaying video stream in a non-binary manner as the user rotates the computing device facilitates keeping the playing video stream in the original user perspective as the device rotates and reduces viewing disruption and confusion as the computing device is rotated.

### Claim 11 (depends on 10)

The computer-implemented method of claim 10, wherein rotating the displaying video stream further comprises:
using tracking mechanisms in the computing device to determine whether the user's orientation relative to the computing device is changing; and
upon determining that the computing device is rotating independently of any changes in the user's orientation, rotating the displaying video stream.

### Claim 12

A non-transitory computer-readable storage medium storing instructions that when executed by a computer cause the computer to perform a method for optimizing the display of videos, the method comprising:
receiving and displaying a video stream on the display of a computing device;
determining an area of emphasis in the video stream; and
adjusting the portion of the video stream being displayed to emphasize the area of emphasis while displaying the video stream.

### Claim 13

A computing device that optimizes the display of videos, comprising:
a processor;
a display;
wherein the processor is configured to:
receive a video stream to be displayed on the display;
display the video steam on the display;
determine an area of emphasis in the video stream; and
adjust the portion of the video stream being displayed on the display to emphasize the area of emphasis while displaying the video stream on the display.
