# US 2022/0044354 A1 · Automatic cropping of video content

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0044354 A1
- Document ID: US20220044354A1
- Status: Published application
- Kind: A1
- Application number: 17/452,167
- Filed: 2021-10-25
- Published: 2022-02-10
- Earliest claimed: 2015-03-09
- Assignees: Apple Inc.
- Applicants: Apple Inc.
- Inventors: May-Li KHOE; Avi E. CIEPLINSKI; David Joshua HART
- Web page: https://patentgrep.com/patent/US20220044354A1

## CPC

- G06T 3/20: Linear translation of whole images or parts thereof, e.g. panning
- G06T 3/04: Context-preserving transformations, e.g. by using an importance map (panospheric to cylindrical image transformations G06T3/12)
- G06T 7/11: Region-based segmentation
- H04N 23/611: where the recognised objects include parts of the human body
- H04N 23/62: Control of parameters via user interfaces
- H04N 23/63: by using electronic viewfinders
- H04N 25/443: by reading pixels from selected two-dimensional [2D] regions of the array, e.g. for windowing or digital zooming
- G06T 2207/20132: Image cropping
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Electronic devices are often equipped with a camera for capturing video content and/or a display for displaying video content. However, amateur users often capture video content without regard to composition, framing, or camera movement, resulting in video content that can be jarring or confusing to viewers. There is a need to automate the processing and presentation of video content in an aesthetically pleasing manner. The embodiments described herein provide a method of automatically cropping video content for presentation on a display.

## Claims

### Claim 1

A method comprising:
at a first electronic device in communication with a display device and a camera:
displaying, via the display device, a first portion of video content corresponding to a video call including the first electronic device and a second electronic device, wherein the first portion of the video content includes a first subject having a first range of movement;
while displaying the first portion of the video content, detecting, via the camera, a second range of movement of the first subject; and
in response to detecting the second range of movement of the first subject:
in accordance with a determination that the second range of movement satisfies one or more criteria, maintaining display, via the display device, of the first portion of the video content including the first subject; and
in accordance with a determination that the second range of movement does not satisfy the one or more criteria, displaying, via the display device, a second portion of the video content, different from the first portion of the video content, wherein the second portion of the video content corresponds to the second range of movement of the first subject.

### Claim 2 (depends on 1)

The method of claim 1, wherein the second range of movement is smaller than the first range of movement, the second portion of the video content is smaller than the first portion of the video content, and at least a respective portion of the first portion of the video content is not displayed while displaying the second portion of the video content.

### Claim 3 (depends on 1)

The method of claim 1, wherein the second range of movement is larger than the first range of movement, the second portion of the video content is larger than the first portion of the video content, and at least a respective portion of the second portion of the video content is not displayed while displaying the first portion of the video content.

### Claim 4 (depends on 1)

The method of claim 1, wherein the detection of the second range of movement of the first subject is based on image recognition of the video content.

### Claim 5 (depends on 1)

The method of claim 1, wherein the one or more criteria include a criterion that is satisfied when the second range of movement has a respective relationship to the first portion of the video content.

### Claim 6 (depends on 5)

The method of claim 5, wherein the criterion is satisfied when the second range of movement does not fall outside of the first portion of the video content.

### Claim 7 (depends on 5)

The method of claim 5, wherein the criterion is satisfied when the second range of movement is greater than a respective relative size relative to the first portion of the video content.

### Claim 8 (depends on 7)

The method of claim 7, wherein the one or more criteria are not satisfied when the second range of movement is less than the respective relative size relative to the first portion of the video content.

### Claim 9 (depends on 1)

The method of claim 1, wherein the second range of movement does not satisfy the one or more criteria, and the second portion of the video content is smaller than the first portion of the video content, the method further comprising:
after detecting the second range of movement and while displaying, via the display device, the second portion of the video content, detecting, via the camera, that the first subject has stopped moving; and
in response to detecting that the first subject has stopped moving, displaying, via the display device, a third portion of the video content, smaller than the first portion and the second portion of the video content, that includes the first subject.

### Claim 10 (depends on 1)

The method of claim 1, wherein the second range of movement does not satisfy the one or more criteria, and the second portion of the video content is smaller than the first portion of the video content, the method further comprising:
after detecting the second range of movement and while displaying, via the display device, the second portion of the video content, detecting, via the camera, a third range of movement of the first subject; and
in response to detecting the third range of movement of the first subject:
in accordance with a determination that the third range of movement satisfies one or more second criteria, displaying, via the display device, a third portion of the video content, larger than the second portion of the video content, that includes the first subject.

### Claim 11 (depends on 1)

The method of claim 1, further comprising:
while displaying the first portion of the video content, wherein the video content captured by the camera in communication with the first electronic device includes the first subject and a second subject, and the first portion of the video content includes the first subject but not the second subject, detecting, via the camera, a respective motion performed by the second subject in the video content; and
in response to detecting the respective motion performed by the second subject:
in accordance with a determination that the respective motion satisfies one or more criteria, displaying, via the display device, a third portion of the video content, different from the first portion of the video content, wherein the third portion of the video content includes the first subject and the second subject.

### Claim 12 (depends on 1)

The method of claim 1, further comprising:
while displaying the first portion of the video content, wherein the first portion of the video content includes the first subject and a second subject, detecting an event corresponding to a request to designate the second subject as inactive; and
while the second subject is designated as inactive, displaying, via the display device, a third portion of the video content, smaller than the first portion of the video content, that includes the first subject but does not include the second subject.

### Claim 13

A non-transitory computer-readable storage medium including instructions, which when executed by a first electronic device in communication with a display device and a camera, cause the first electronic device to perform a method comprising:
displaying, via the display device, a first portion of video content corresponding to a video call including the first electronic device and a second electronic device, wherein the first portion of the video content includes a first subject having a first range of movement;
while displaying the first portion of the video content, detecting, via the camera, a second range of movement of the first subject; and
in response to detecting the second range of movement of the first subject:
in accordance with a determination that the second range of movement satisfies one or more criteria, maintaining display, via the display device, of the first portion of the video content including the first subject; and
in accordance with a determination that the second range of movement does not satisfy the one or more criteria, displaying, via the display device, a second portion of the video content, different from the first portion of the video content, wherein the second portion of the video content corresponds to the second range of movement of the first subject.

### Claim 14

A first electronic device comprising:
one or more processors; and
memory storing instructions, which when executed by the one or more processors, cause the first electronic device to perform a method comprising:
displaying, via a display device, a first portion of video content corresponding to a video call including the first electronic device and a second electronic device, wherein the first portion of the video content includes a first subject having a first range of movement;
while displaying the first portion of the video content, detecting, via a camera, a second range of movement of the first subject; and
in response to detecting the second range of movement of the first subject:
in accordance with a determination that the second range of movement satisfies one or more criteria, maintaining display, via the display device, of the first portion of the video content including the first subject; and
in accordance with a determination that the second range of movement does not satisfy the one or more criteria, displaying, via the display device, a second portion of the video content, different from the first portion of the video content, wherein the second portion of the video content corresponds to the second range of movement of the first subject.
