# US 2025/0166337 A1 · Method for Converting Landscape Video to Portrait Mobile Layout Using a Selection Interface

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0166337 A1
- Document ID: US20250166337A1
- Status: Published application
- Kind: A1
- Application number: 19/029,798
- Filed: 2025-01-17
- Published: 2025-05-22
- Earliest claimed: 2017-12-05
- Assignees: Google Inc.
- Applicants: Google LLC
- Inventors: Brian Mulford; Nathan Frey; Alexandros Panagopoulos; Yinquan Hao; Yuan Zhang
- Web page: https://patentgrep.com/patent/US20250166337A1

## CPC

- G06V 10/25: Determination of region of interest [ROI] or a volume of interest [VOI]
- G06F 3/04845: for image manipulation, e.g. dragging, rotation, expansion or change of colour
- G06T 3/10: Selection of transformation methods according to the characteristics of the input images
- G06T 7/11: Region-based segmentation
- G06T 11/20: Drawing from basic elements
- G06V 20/05: Underwater scenes
- G09G 5/373: for modifying the size of the graphic pattern
- G06T 2207/20132: Image cropping
- G06T 2210/12: Bounding box
- G09G 2340/0442: Handling or displaying different aspect ratios, or changing the aspect ratio
- G09G 2340/045: Zooming at least part of an image, i.e. enlarging it or shrinking it
- H04N 7/0122: {the input and the output signals having different aspect ratios}
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Described herein are systems and methods of converting media dimensions. A device may identify a set of frames from a video in a first orientation as belonging to a scene. The device may receive a selected coordinate on a frame of the set of frames for the scene. The device may identify a first region within the frame including a first feature corresponding to the selected coordinate and a second region within the frame including a second feature. The device may generate a first score for the first feature and a second score for the second feature. The first score may be greater than the second score based on the first feature corresponding to the selected coordinate. The device may crop the frame to include the first region and the second region within a predetermined display area comprising a subset of regions of the frame in a second orientation.

## Claims

### Claim 1

A computer-implemented method, comprising:
receiving, by a temporal analyzer executing on a computing device, a plurality of frames of video content;
identifying, by an image analyzer executing on the computing device, a frame of video content cropped based on one or more regions previously identified as including a feature;
identifying a selected region in the frame corresponding to a selected feature;
determining that the selected region is within the cropped frame; and
based on determining that the selected region is within the cropped frame, maintaining the cropped frame of the video content.

### Claim 2 (depends on 1)

The computer-implemented method of claim 1, comprising:
identifying, by the image analyzer executing on the computing device, a second frame of video content cropped based on the one or more regions previously identified as including the feature;
identifying a second selected region in the second frame corresponding to the selected feature;
determining that the second selected region is not within the second cropped frame;
based on determining that the second selected region is not within the second cropped frame, recalculating a score for each previously identified feature within the second frame; and
cropping the second frame of video content to include the selected region and the one or more regions with the recalculated scores.

### Claim 3 (depends on 2)

The computer-implemented method of claim 2, wherein recalculating the score for each previously identified feature within the second frame is determined based on a distance between one or more second features previously identified to the selected feature.

### Claim 4 (depends on 1)

The computer-implemented method of claim 1, wherein identifying the selected region in the cropped frame is performed using a deep learning inference model.

### Claim 5 (depends on 1)

The computer-implemented method of claim 1, wherein identifying the selected region in the cropped frame corresponding to the selected feature is performed using an image recognition algorithm.

### Claim 6 (depends on 1)

The computer-implemented method of claim 1, wherein the selected feature is identified using an image analysis technique.

### Claim 7 (depends on 6)

The computer-implemented method of claim 6, wherein the image analysis technique comprises at least one of facial recognition, optical character recognition, or object recognition.

### Claim 8 (depends on 1)

The computer-implemented method of claim 1, wherein the selected features is identified based on at least one or a coordinate, a bounding area, or a feature identifier received via a selection interface.

### Claim 9 (depends on 1)

The computer-implemented method of claim 1, wherein determining that the selected region is within the cropped frame is based on determining that a threshold percentage of the selected region overlaps with the cropped frame.

### Claim 10 (depends on 9)

The computer-implemented method of claim 9, wherein the threshold percentage comprises a value between 50-100%.

### Claim 11

A computing system, comprising:
one or more processors; and
one or more computer-readable media storing instructions that are executable to cause the one or more processors to perform operations, the operations comprising:
receiving, by a temporal analyzer executing on a computing device, a plurality of frames of video content;
identifying, by an image analyzer executing on the computing device, a frame of video content cropped based on one or more regions previously identified as including a feature;
identifying a selected region in the frame corresponding to a selected feature;
determining that the selected region is within the cropped frame; and
based on determining that the selected region is within the cropped frame, maintaining the cropped frame of the video content.

### Claim 12 (depends on 11)

The computing system of claim 11, the operations comprising:
identifying, by the image analyzer executing on the computing device, a second frame of video content cropped based on the one or more regions previously identified as including the feature;
identifying a second selected region in the second frame corresponding to the selected feature;
determining that the second selected region is not within the second cropped frame;
based on determining that the second selected region is not within the second cropped frame, recalculating a score for each previously identified feature within the second frame; and
cropping the second frame of video content to include the selected region and the one or more regions with the recalculated scores.

### Claim 13 (depends on 12)

The computing system of claim 12, wherein recalculating the score for each previously identified feature within the second frame is determined based on a distance between one or more second features previously identified to the selected feature.

### Claim 14 (depends on 11)

The computing system of claim 11, wherein identifying the selected region in the cropped frame is performed using a deep learning inference model.

### Claim 15 (depends on 11)

The computing system of claim 11, wherein identifying the selected region in the cropped frame corresponding to the selected feature is performed using an image recognition algorithm.

### Claim 16 (depends on 11)

The computing system of claim 11, wherein the selected feature is identified using an image analysis technique.

### Claim 17 (depends on 16)

The computing system of claim 16, wherein the image analysis technique comprises at least one of facial recognition, optical character recognition, or object recognition.

### Claim 18 (depends on 11)

The computing system of claim 11, wherein the selected features is identified based on at least one or a coordinate, a bounding area, or a feature identifier received via a selection interface.

### Claim 19

One or more non-transitory computer readable media storing instructions that are executable by one or more processors to perform operations comprising:
receiving, by a temporal analyzer executing on a computing device, a plurality of frames of video content;
identifying, by an image analyzer executing on the computing device, a frame of video content cropped based on one or more regions previously identified as including a feature;
identifying a selected region in the frame corresponding to a selected feature;
determining that the selected region is within the cropped frame; and
based on determining that the selected region is within the cropped frame, maintaining the cropped frame of the video content.

### Claim 20 (depends on 19)

The one or more non-transitory computer readable media of claim 19, the operations comprising:
identifying, by the image analyzer executing on the computing device, a second frame of video content cropped based on the one or more regions previously identified as including the feature;
identifying a second selected region in the second frame corresponding to the selected feature;
determining that the second selected region is not within the second cropped frame;
based on determining that the second selected region is not within the second cropped frame, recalculating a score for each previously identified feature within the second frame; and cropping the second frame of video content to include the selected region and the one or more regions with the recalculated scores.
