# US 2021/0279969 A1 · Crowd sourced mapping system

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0279969 A1
- Document ID: US20210279969A1
- Status: Published application
- Kind: A1
- Application number: 17/329,435
- Filed: 2021-05-25
- Published: 2021-09-09
- Earliest claimed: 2019-06-20
- Assignees: Snap Inc.
- Applicants: Snap Inc.
- Inventors: Piers Cowburn; Isac Andreas Müller Sandvik; Qi Pan; David Li
- Web page: https://patentgrep.com/patent/US20210279969A1

## CPC

- G06T 17/05: Geographic models
- G06F 16/51: Indexing; Data structures therefor; Storage structures
- G06F 16/54: Browsing; Visualisation therefor
- G06F 16/587: using geographical or spatial information, e.g. location
- G06Q 20/102: {Bill distribution or payments}
- G06Q 20/4016: {involving fraud or risk level assessment in transaction processing}
- G06Q 20/405: {Establishing or using transaction specific rules}
- G06T 7/97: {Determining parameters from multiple pictures (depth or shape recovery from multiple images G06T7/55; stereo camera calibration G06T7/85)}
- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- G06T 19/20: Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts
- H04L 51/10: Multimedia information
- H04L 51/224: providing notification on incoming messages, e.g. pushed notifications of received messages
- H04L 67/51: Discovery or management thereof, e.g. service location protocol [SLP] or web services
- H04L 67/52: specially adapted for the location of the user terminal
- G06T 2200/24: involving graphical user interfaces [GUIs]
- G06T 2219/024: Multi-user, collaborative environment
- G06T 2219/2021: Shape modification
- H04L 51/222: using geographical location information, e.g. messages transmitted or received in proximity of a certain spot or area
- H04L 67/55: Push-based network services
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)

## Abstract

A crowd-sourced modeling system to perform operations that include: receiving image data that comprises image attributes; accessing a 3D model based on at least the image attributes of the image data, wherein the 3D model comprises a plurality of parts that collectively depict an object or environment; identifying a change in the object or environment based on a comparison of the image data with the plurality of parts of the 3D model, the change corresponding to a part of the 3D model from among the plurality of parts; and generating an update to the part of the 3D model based on the image attributes of the image data.

## Claims

### Claim 1

A method comprising:
detecting a client device within a threshold distance of a location;
presenting a guide at the client device, the guide directing a user of the client device to the location;
detecting the client device at the location;
accessing image data at the client device based on the detecting the client device at the location, the image data comprising image attributes; and
generating a portion of a 3D model based on the image attributes of the image data.

### Claim 2 (depends on 1)

The method of claim 1, wherein the accessing the image data at the client device includes:
accessing a repository that comprises a collection of image data associated with the location, the collection of image data including at least the image data.

### Claim 3 (depends on 1)

The method of claim 1, wherein the accessing image data at the client device based on the detecting the client device at the location includes:
causing display of a request for the image data at the client device in response to the detecting the client device at the location; and
receiving the image data at the client device.

### Claim 4 (depends on 1)

The method of claim 1, wherein the presenting the guide that directs the user to the location includes:
causing display of an augmented reality (AR) indicator at the client device, the AR indicator directing the user to the location.

### Claim 5 (depends on 1)

The method of claim 1, wherein the detecting the client device within the threshold distance of the location includes:
detecting a change in an environment that corresponds with the location; and
identifying the client device within the threshold distance of the location in response to the detecting the change in the environment.

### Claim 6 (depends on 1)

The method of claim 1, wherein the 3D model includes a 3D mesh model that depicts a surface feature of the location.

### Claim 7 (depends on 1)

The method of claim 1, wherein the accessing the image data at the client device based on the detecting the client device at the location includes:
selecting the image data based on the image attributes of the image data, the image attributes including image metadata.

### Claim 8

A system comprising:
a memory; and
at least one hardware processor coupled to the memory and comprising instructions that causes the system to perform operations comprising:
detecting a client device within a threshold distance of a location;
presenting a guide at the client device, the guide directing a user of the client device to the location;
detecting the client device at the location;
accessing image data at the client device based on the detecting the client device at the location, the image data comprising image attributes; and
generating a portion of a 3D model based on the image attributes of the image data.

### Claim 9 (depends on 8)

The system of claim 8, wherein the accessing the image data at the client device includes:
accessing a repository that comprises a collection of image data associated with the location, the collection of image data including at least the image data.

### Claim 10 (depends on 8)

The system of claim 8, wherein the accessing image data at the client device based on the detecting the client device at the location includes:
causing display of a request for the image data at the client device in response to the detecting the client device at the location; and
receiving the image data at the client device.

### Claim 11 (depends on 8)

The system of claim 8, wherein the presenting the guide that directs the user to the location includes:
causing display of an augmented reality (AR) indicator at the client device, the AR indicator directing the user to the location.

### Claim 12 (depends on 8)

The system of claim 8, wherein the detecting the client device within the threshold distance of the location includes:
detecting a change in an environment that corresponds with the location; and
identifying the client device within the threshold distance of the location in response to the detecting the change in the environment.

### Claim 13 (depends on 8)

The system of claim 8, wherein the 3D model includes a 3D mesh model that depicts a surface feature of the location.

### Claim 14 (depends on 8)

The system of claim 8, wherein the accessing the image data at the client device based on the detecting the client device at the location includes:
selecting the image data based on the image attributes of the image data, the image attributes including image metadata.

### Claim 15

A non-transitory machine-readable storage medium comprising instructions that, when executed by one or more processors of a machine, cause the machine to perform operations comprising:
detecting a client device within a threshold distance of a location;
presenting a guide at the client device, the guide directing a user of the client device to the location;
detecting the client device at the location;
accessing image data at the client device based on the detecting the client device at the location, the image data comprising image attributes; and
generating a portion of a 3D model based on the image attributes of the image data.

### Claim 16 (depends on 15)

The non-transitory machine-readable storage medium of claim 15, wherein the accessing the image data at the client device includes:
accessing a repository that comprises a collection of image data associated with the location, the collection of image data including at least the image data.

### Claim 17 (depends on 15)

The non-transitory machine-readable storage medium of claim 15, wherein the accessing image data at the client device based on the detecting the client device at the location includes:
causing display of a request for the image data at the client device in response to the detecting the client device at the location; and
receiving the image data at the client device.

### Claim 18 (depends on 15)

The non-transitory machine-readable storage medium of claim 15, wherein the presenting the guide that directs the user to the location includes:
causing display of an augmented reality (AR) indicator at the client device, the AR indicator directing the user to the location.

### Claim 19 (depends on 15)

The non-transitory machine-readable storage medium of claim 15, wherein the detecting the client device within the threshold distance of the location includes:
detecting a change in an environment that corresponds with the location; and
identifying the client device within the threshold distance of the location in response to the detecting the change in the environment.

### Claim 20 (depends on 15)

The non-transitory machine-readable storage medium of claim 15, wherein the 3D model includes a 3D mesh model that depicts a surface feature of the location.