# US 2025/0168488 A1 · Scaled perspective zoom on resource constrained devices

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0168488 A1
- Document ID: US20250168488A1
- Status: Published application
- Kind: A1
- Application number: 19/029,202
- Filed: 2025-01-17
- Published: 2025-05-22
- Earliest claimed: 2017-06-15
- Assignees: Snap Inc.
- Applicants: Snap Inc.
- Inventors: Linjie Luo; Chongyang Ma; Zehao Xue
- Web page: https://patentgrep.com/patent/US20250168488A1

## CPC

- H04N 23/62: Control of parameters via user interfaces
- H04N 5/2628: {Alteration of picture size, shape, position or orientation, e.g. zooming, rotation, rolling, perspective, translation}
- H04N 5/272: Means for inserting a foreground image in a background image, i.e. inlay, outlay
- H04N 23/611: where the recognised objects include parts of the human body
- H04N 23/63: by using electronic viewfinders
- H04N 23/661: Transmitting camera control signals through networks, e.g. control via the Internet
- H04N 23/683: {performed by a processor, e.g. controlling the readout of an image memory}
- H04N 23/69: Control of means for changing angle of the field of view, e.g. optical zoom objectives or electronic zooming
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A dolly zoom effect can be applied to one or more images captured via a resource-constrained device (e.g., a mobile smartphone) by manipulating the size of a target feature while the background in the one or more images changes due to physical movement of the resource-constrained device. The target feature can be detected using facial recognition or shape detection techniques. The target feature can be resized before the size is manipulated as the background changes (e.g., changes perspective).

## Claims

### Claim 1

A method comprising:
generating an image using an image sensor of a user device;
receiving, at the user device, a user selection indicating a depiction of a physical object in a first region in the image, the image comprising a second region that excludes the first region;
generating a zoom video sequence by resizing the first region, maintaining a scaling of resized first region in the zoom video sequence as the user device moves closer to or away from the physical object, and adjusting a scaling of the second region in the zoom video sequence as the user device moves closes to or away from the physical object; and
storing the zoom video sequence on the user device.

### Claim 2 (depends on 1)

The method of claim 1, wherein the first region includes the depiction of the physical object, and the second region includes a remaining area of the image complementing the first region.

### Claim 3 (depends on 1)

The method of claim 1, further comprising:
receiving, through a touchscreen of the user device, an instruction to change a size of the depiction of the physical object in the zoom video sequence.

### Claim 4 (depends on 1)

The method of claim 1, further comprising:
generating, using a convolutional neural network, image feature areas for different image features in the image;
identifying, on the user device, a target image feature from one of the image feature areas, the target image feature corresponding to the physical object depicted in the image; and
resizing the target image feature.

### Claim 5 (depends on 4)

The method of claim 4, further comprising:
maintaining a scaling of the resized target image feature in the zoom video sequence without maintaining the scaling of image features areas that are not the target image feature such that the resized target image feature covers the depiction of the physical object in the zoom video sequence as the user device moves closer to or away from the physical object.

### Claim 6 (depends on 1)

The method of claim 1, further comprising:
receiving, through a touchscreen of the user device, an instruction to change the depiction of the physical object from an initial size to a size that is manipulated by increased scaling in the zoom video sequence.

### Claim 7 (depends on 1)

The method of claim 1, wherein the physical object is one of a human face, a segment of a human body, or a shape in the image.

### Claim 8 (depends on 1)

The method of claim 1, further comprising:
stabilizing the depiction of the physical object in the zoom video sequence such that the depiction of the physical object remains in an initial area in the zoom video sequence.

### Claim 9 (depends on 1)

The method of claim 1, wherein the image is from a live video feed generated by a front-facing camera of the user device, the user device having the front-facing camera and a rear-facing camera.

### Claim 10 (depends on 1)

The method of claim 1, further comprising:
generating an ephemeral message comprising the zoom video sequence; and
transmitting the ephemeral message to a network server.

### Claim 11

A user device comprising:
one or more processors;
an image sensor; and
a memory storing instructions that, when executed by the one or more processors, cause the user device to perform operations comprising:
generating an image using the image sensor;
receiving, at the user device, a user selection indicating a depiction of a physical object in a first region in the image, the image comprising a second region that excludes the first region;
generating a zoom video sequence by resizing the first region, maintaining a scaling of resized first region in the zoom video sequence as the user device moves closer to or away from the physical object, and adjusting a scaling of the second region in the zoom video sequence as the user device moves closes to or away from the physical object; and
storing the zoom video sequence on the user device.

### Claim 12 (depends on 11)

The user device of claim 11, wherein the first region includes the depiction of the physical object, and the second region includes a remaining area of the image complementing the first region.

### Claim 13 (depends on 11)

The user device of claim 11, wherein the operations further comprise:
receiving, through a touchscreen of the user device, an instruction to change a size of the depiction of the physical object in the zoom video sequence.

### Claim 14 (depends on 11)

The user device of claim 11, wherein the operations further comprise:
generating, using a convolutional neural network, image feature areas for different image features in the image;
identifying, on the user device, a target image feature from one of the image feature areas, the target image feature corresponding to the physical object depicted in the image; and
resizing the target image feature.

### Claim 15 (depends on 14)

The user device of claim 14, wherein the operations further comprise:
maintaining a scaling of the resized target image feature in the zoom video sequence without maintaining the scaling of image features areas that are not the target image feature such that the resized target image feature covers the depiction of the physical object in the zoom video sequence as the user device moves closer to or away from the physical object.

### Claim 16 (depends on 11)

The user device of claim 11, wherein the operations further comprise:
receiving, through a touchscreen of the user device, an instruction to change the depiction of the physical object from an initial size to a size that is manipulated by increased scaling in the zoom video sequence.

### Claim 17 (depends on 11)

The user device of claim 11, wherein the physical object is one of a human face, a segment of a human body, or a shape in the image.

### Claim 18 (depends on 11)

The user device of claim 11, wherein the operations further comprise:
stabilizing the depiction of the physical object in the zoom video sequence such that the depiction of the physical object remains in an initial area in the zoom video sequence.

### Claim 19 (depends on 11)

The user device of claim 11, wherein the image is from a live video feed generated by a front-facing camera of the user device, the user device having the front-facing camera and a rear-facing camera.

### Claim 20

A non-transitory machine-readable storage device embodying instructions that, when executed by a machine, cause the machine to perform operations comprising:
generating an image using an image sensor of a user device;
receiving, at the user device, a user selection indicating a depiction of a physical object in a first region in the image, the image comprising a second region that excludes the first region;
generating a zoom video sequence by resizing the first region, maintaining a scaling of resized first region in the zoom video sequence as the user device moves closer to or away from the physical object, and adjusting a scaling of the second region in the zoom video sequence as the user device moves closes to or away from the physical object; and
storing the zoom video sequence on the user device.
