# US 2021/0241477 A1 · Enabling automatic measurements

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0241477 A1
- Document ID: US20210241477A1
- Status: Published application
- Kind: A1
- Application number: 17/234,640
- Filed: 2021-04-19
- Published: 2021-08-05
- Earliest claimed: 2019-02-28
- Assignees: Apple Inc.
- Applicants: Apple Inc.
- Inventors: Alexandre da VEIGA
- Web page: https://patentgrep.com/patent/US20210241477A1

## CPC

- G06T 7/55: from multiple images
- G06V 20/46: {Extracting features or characteristics from the video content, e.g. video fingerprints, representative shots or key frames}
- G06T 2207/10016: Video; Image sequence
- G06T 2207/20101: Interactive definition of point of interest, landmark or seed
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

In accordance with some embodiments, a technique that enables an electronic device with a camera to automatically gather and generate requisite data from the real-world environment to allow the electronic device to quickly and efficiently determine and provide accurate measurements of physical spaces and/or objects within the real-world environment is described.

## Claims

### Claim 1

An electronic device, comprising:
a camera;
one or more processors; and
a memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for:
prior to detecting a request to measure a distance between real-world points using an application on the electronic device, capturing, via the camera, a plurality of images along a path of movement of the electronic device from a first location to a second location, wherein the first location corresponds to a location of the electronic device when the application is activated on the electronic device;
determining keyframes based on one or more characteristics of the plurality of images;
storing the keyframes; and
in response to detecting the request to measure the distance:
determining the distance between the real-world points using one or more of the stored keyframes; and
displaying, in a user interface of the application, a representation of the distance.

### Claim 2 (depends on 1)

The electronic device of claim 1, the one or more programs further including instructions for:
displaying a second user interface that does not correspond to the application when the application is not activated on the electronic device; and
displaying the user interface of the application instead of the second user interface when the application is activated on the electronic device.

### Claim 3 (depends on 1)

The electronic device claim 1, wherein the second location corresponds to a location of the electronic device when the request to measure the distance is detected on the electronic device.

### Claim 4 (depends on 1)

The electronic device claim 1, wherein detecting the request to measure the distance comprises detecting selection of a measurement point in the user interface of the application, wherein the measurement point in the user interface corresponds to a first real-world point of the real-world points in a real-world environment.

### Claim 5 (depends on 1)

The electronic device claim 1, wherein determining the keyframes based on one or more characteristics of the plurality of images comprises selecting, as the keyframes, one or more of the plurality of images based on the one or more characteristics.

### Claim 6 (depends on 1)

The electronic device claim 1, wherein the one or more characteristics include an amount of movement of the electronic device between a location of the electronic device corresponding to a first image of the plurality of images and a location of the electronic device corresponding to a second image of the plurality of images.

### Claim 7 (depends on 1)

The electronic device claim 1, wherein the one or more characteristics include an image quality of a first image of the plurality of images.

### Claim 8 (depends on 1)

The electronic device claim 1, wherein the one or more characteristics include a brightness level of a first image of the plurality of images.

### Claim 9 (depends on 1)

The electronic device claim 1, the one or more programs further including instructions for:
determining feature points based on the keyframes, wherein the feature points identify a real-world object captured in the keyframes, and wherein the real-world points correspond to points on the real-world object.

### Claim 10 (depends on 1)

The electronic device claim 1, wherein the path of movement of the electronic device from the first location to the second location includes movement of the electronic device in an x-direction and a y-direction in a three-dimensional plane.

### Claim 11 (depends on 1)

The electronic device claim 1, the one or more programs further including instructions for:
subsequent to determining the distance between the real-world points using one or more of the stored keyframes, capturing, via the camera, a second plurality of images along a second path of movement of the electronic device;
determining new keyframes based on one or more characteristics of the second plurality of images;
storing the new keyframes;
determining an updated distance between the real-world points using one or more of the stored new keyframes; and
displaying, in the user interface of the application, a representation of the updated distance.

### Claim 12

A method, comprising:
at an electronic device with a camera:
prior to detecting a request to measure a distance between real-world points using an application on the electronic device, capturing, via the camera, a plurality of images along a path of movement of the electronic device from a first location to a second location, wherein the first location corresponds to a location of the electronic device when the application is activated on the electronic device;
determining keyframes based on one or more characteristics of the plurality of images;
storing the keyframes; and
in response to detecting the request to measure the distance:
determining the distance between the real-world points using one or more of the stored keyframes; and
displaying, in a user interface of the application, a representation of the distance.

### Claim 13

A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of an electronic device with a camera, the one or more programs including instructions for:
prior to detecting a request to measure a distance between real-world points using an application on the electronic device, capturing, via the camera, a plurality of images along a path of movement of the electronic device from a first location to a second location, wherein the first location corresponds to a location of the electronic device when the application is activated on the electronic device;
determining keyframes based on one or more characteristics of the plurality of images;
storing the keyframes; and
in response to detecting the request to measure the distance:
determining the distance between the real-world points using one or more of the stored keyframes; and
displaying, in a user interface of the application, a representation of the distance.
