# US 12,010,454 B2 · Accessibility measurement system

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,010,454 B2
- Document ID: US12010454B2
- Status: Granted
- Kind: B2
- Application number: 17/665,993
- Filed: 2022-02-07
- Published: 2023-08-10
- Granted: 2024-06-11
- Earliest claimed: 2022-02-07
- Assignees: Airbnb, Inc.
- Applicants: Airbnb, Inc.
- Inventors: Ortal Yahdav; Hilary Catherine Sun; Aishwarya Nirmal
- Web page: https://patentgrep.com/patent/US12010454B2

## CPC

- H04N 5/272: Means for inserting a foreground image in a background image, i.e. inlay, outlay
- G01B 11/22: for measuring depth
- G01C 19/00: Gyroscopes; Turn-sensitive devices using vibrating masses; Turn-sensitive devices without moving masses; Measuring angular rate using gyroscopic effects
- G01P 15/00: Measuring acceleration; Measuring deceleration; Measuring shock, i.e. sudden change of acceleration
- G01S 17/88: Lidar systems specially adapted for specific applications
- G01S 17/894: Three-dimensional [3D] imaging with simultaneous measurement of time-of-flight at a two-dimensional [2D] array of receiver pixels, e.g. time-of-flight cameras or flash lidar
- G06Q 30/0641: {utilising user interfaces specially adapted for shopping}
- G06Q 30/0643: {graphically representing goods, e.g. 3D product representation}
- G06T 7/50: Depth or shape recovery
- H04N 23/63: by using electronic viewfinders
- H04N 23/633: {for displaying additional information relating to control or operation of the camera}
- H04N 23/64: {Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G01B: MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
- G01C: MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY (measuring liquid level G01F; radio navigation, determining distance or velocity by use of propagation effects, e.g. Doppler effects, propagation time, of radio waves, analogous arrangements using other waves G01S)
- G01P: MEASURING LINEAR OR ANGULAR SPEED, ACCELERATION, DECELERATION, OR SHOCK; INDICATING PRESENCE, ABSENCE, OR DIRECTION, OF MOVEMENT (measuring or recording blood flow A61B5/02, A61B8/06; monitoring speed or deceleration of electrically-propelled vehicles B60L3/00; vehicle lighting systems adapted to indicate speed B60Q1/54; determining position or course in navigation, measuring ground distance in geodesy or surveying G01C; combined measuring devices for measuring two or more variables of movement G01C23/00; measuring velocity of sound G01H; measuring velocity of light G01J7/00; measuring direction or velocity of solid objects by reception or emission of radiowaves or other waves and based on propagation effects, e.g. Doppler effect, propagation time, direction of propagation, G01S; measuring speed of nuclear radiation G01T; measuring acceleration of gravity G01V; {measuring or recording the speed of trains B61L23/00; speed indicators incorporated in motor vehicles B60K35/00; measuring frequency or phase G01R; traffic control G08G})
- G01S: RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

Systems and methods are provided to analyze at least one sensor of a computing device to determine that the computing device is in a substantially flat position on the first surface, activate a camera comprising a depth sensor, and detect a second surface in a camera view of the camera. The computing device further analyzes pixel measurements from the depth sensor in a predefined area of the detected second surface to determine a minimum measurement of all of the pixel measurements in the predefined area of the detected surface, causes display of the minimum measurement from the first surface to the second surface overlaid on an image of the first and second surface in the camera view on a user interface of the computing device, and captures an image of the display.

## Claims

### Claim 1

A computer-implemented method, comprising:
analyzing, by a computing device, at least one sensor of the computing device to determine that the computing device is in a substantially flat position on a first surface;
activating, by the computing device, a camera of the computing device, the camera comprising a depth sensor;
detecting, by the computing device, a second surface in a camera view of the camera;
analyzing, by the computing device, pixel measurements from the depth sensor in a predefined area of the detected second surface to determine a minimum measurement of all of the pixel measurements in the predefined area of the detected surface;
causing display, by the computing device, of the minimum measurement from the first surface to the second surface overlaid on an image of the first and second surface in the camera view on a user interface of the computing device; and
capturing, by the computing device, an image of the display of the minimum measurement from the first surface to the second surface overlaid on the image of the first and second surface.

### Claim 2 (depends on 1)

The method of claim 1, wherein before analyzing the at least one sensor of the computing device to determine that the computing device is in a substantially flat position on a first surface, the method comprises:
prompting, via the user interface of the computing device, a user to place a front-side or back-side of the computing device on the first surface.

### Claim 3 (depends on 1)

The method of claim 1, wherein analyzing the at least one sensor of the computing device to determine that the computing device is in a substantially flat position on the first surface comprises determining that the yaw, pitch, and roll detected by the at least one sensor is zero or close to zero.

### Claim 4 (depends on 1)

The method of claim 1, wherein the at least one sensor of the computing device is an accelerometer or a gyroscope.

### Claim 5 (depends on 1)

The method of claim 1, wherein the first surface is one side of a doorframe and the second surface is an opposite other side of the doorframe.

### Claim 6 (depends on 1)

The method of claim 1, further comprising:
causing the image to be included with other images for a listing in an online marketplace.

### Claim 7 (depends on 1)

The method of claim 1, further comprising:
setting a first coordinate of the computing device at a location where the computing device is placed on the first surface;
projecting a line perpendicular from the first coordinate to a point out to the minimum measurement on the second surface; and
overlaying a line between the first coordinate on the first surface and the point on the second surface, wherein the display of the minimum measurement from the first surface to the second surface overlaid on the image of the first and second surface comprises the line.

### Claim 8 (depends on 1)

The method of claim 1, wherein before capturing the image of the display of the minimum measurement from the first surface to the second surface overlaid on the image of the first and second surface, the method comprises:
detecting that a first point where the computing device was on the first surface and a second point perpendicular to the first point are not within a threshold position within a camera view of a camera of the computing device; and
causing instructions to display in the user interface to adjust the view of the display of the minimum measurement from the first surface to the second surface overlaid on the image of the first and second surface.

### Claim 9 (depends on 8)

The method of claim 8, wherein an option to capture the image of the display of the minimum measurement from the first surface to the second surface overlaid on the image of the first and second surface is disabled until the computing device detects that the first point and second point are within the threshold position within the camera view.

### Claim 10 (depends on 1)

The computer-implemented method of claim 1, wherein the predefined area comprises a portion of an image of the detected second surface in the camera view.

### Claim 11

A computing device comprising:
a memory that stores instructions; and
one or more processors configured by the instructions to perform operations comprising:
analyzing at least one sensor of the computing device to determine that the computing device is in a substantially flat position on a first surface;
activating a camera of the computing device, the camera comprising a depth sensor;
detecting a second surface in a camera view of the camera;
analyzing pixel measurements from the depth sensor in a predefined area of the detected second surface to determine a minimum measurement of all of the pixel measurements in the predefined area of the detected surface;
causing display of the minimum measurement from the first surface to the second surface overlaid on an image of the first and second surface in the camera view on a user interface of the computing device; and
capturing an image of the display of the minimum measurement from the first surface to the second surface overlaid on the image of the first and second surface.

### Claim 12 (depends on 11)

The computing device of claim 11, wherein before analyzing the at least one sensor of the computing device to determine that the computing device is in a substantially flat position on a first surface, the operations comprise:
prompting, via the user interface of the computing device, a user to place a front-side or back-side of the computing device on the first surface.

### Claim 13 (depends on 11)

The computing device of claim 11, wherein analyzing the at least one sensor of the computing device to determine that the computing device is in a substantially flat position on the first surface comprises determining that the yaw, pitch, and roll detected by the at least one sensor is zero or close to zero.

### Claim 14 (depends on 11)

The computing device of claim 11, therein the at least one sensor of the computing device is an accelerometer or a gyroscope.

### Claim 15 (depends on 11)

The computing device of claim 11, wherein the first surface is one side of a doorframe and the second surface is an opposite other side of the doorframe.

### Claim 16 (depends on 11)

The computing device of claim 11, the operations further comprising:
causing the image to be included with other images for a listing in an online marketplace.

### Claim 17 (depends on 11)

The computing device of claim 11, the operations further comprising:
setting a first coordinate of the computing device at a location where the computing device is placed on the first surface;
projecting a line perpendicular from the first coordinate to a point out to the minimum measurement on the second surface; and
overlaying a line between the first coordinate on the first surface and the point on the second surface, wherein the display of the minimum measurement from the first surface to the second surface overlaid on the image of the first and second surface comprises the line.

### Claim 18 (depends on 11)

The computing device of claim 11, wherein before capturing the image of the display of the minimum measurement from the first surface to the second surface overlaid on the image of the first and second surface, the operations comprise:
detecting that a first point where the computing device was on the first surface and a second point perpendicular to the first point are not within a threshold position within a camera view of a camera of the computing device; and
causing instructions to display in the user interface to adjust the view of the display of the minimum measurement from the first surface to the second surface overlaid on the image of the first and second surface.

### Claim 19 (depends on 18)

The computing device of claim 18, wherein an option to capture the image of the display of the minimum measurement from the first surface to the second surface overlaid on the image of the first and second surface is disabled until the computing device detects that the first point and second point are within the threshold position withing the camera view.

### Claim 20

A nontransitory computer-readable medium comprising instructions stored thereon that are executable by at least one processor to cause a computing device to perform operations comprising:
analyzing at least one sensor of the computing device to determine that the computing device is in a substantially flat position on the first surface;
activating a camera of the computing device, the camera comprising a depth sensor;
detecting a second surface in a camera view of the camera;
analyzing pixel measurements from the depth sensor in a predefined area of the detected second surface to determine a minimum measurement of all of the pixel measurements in the predefined area of the detected surface;
causing display of the minimum measurement from the first surface to the second surface overlaid on an image of the first and second surface in the camera view on a user interface of the computing device; and
capturing an image of the display of the minimum measurement from the first surface to the second surface overlaid on the image of the first and second surface.