# US 10,956,791 B2 · Interactive generation and publication of an augmented-reality application

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,956,791 B2
- Document ID: US10956791B2
- Status: Granted
- Kind: B2
- Application number: 16/516,255
- Filed: 2019-07-19
- Published: 2021-01-21
- Granted: 2021-03-23
- Earliest claimed: 2019-07-19
- Assignees: LayerJot, Inc.
- Applicants: LayerJot, Inc.
- Inventors: Etay Gafni; Soren Harner
- Web page: https://patentgrep.com/patent/US10956791B2

## CPC

- G06V 10/764: using classification, e.g. of video objects
- G06F 8/33: Intelligent editors
- G06F 18/2178: {based on feedback of a supervisor}
- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- G06V 10/7784: {based on feedback from supervisors}
- G06V 20/20: in augmented reality scenes
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

An electronic device that specifies or determines information associated with an application is described. During operation, the electronic device may identify one or more objects of interest in an acquired image. Then, the electronic device may determine or specify classifications (such as names) for the one or more objects of interest. Moreover, the electronic device may analyze a context of the one or more objects of interest in order to determine one or more inspection criteria. Once the one or more inspection criteria are determined, the electronic device may receive publishing information (such as designated recipients) and privacy settings (such as is the application private or public). Next, the electronic device may generate the application using the specified or determined information, and may publish or provide the application to one or more other electronic devices associated with the designated recipients using the publishing information and the privacy settings.

## Claims

### Claim 1

An electronic device, comprising:
an image sensor configured to selectively acquire an image of an environment that comprises objects;
a display;
an interface circuit configured to communicate with a computer;
a processor, coupled to the image sensor, the display, the interface circuit and a memory, configured to execute the program instructions; and
the memory configured to store the program instructions, wherein, when executed by the processor, the program instructions cause the electronic device to perform operations comprising:
displaying a current field of view of the image sensor;
in response to an image-acquisition input, acquiring the image using the image sensor;
identifying and selecting at least a subset of the objects based at least in part on analysis of the image;
receiving classifications for objects in the subset;
determining one or more inspection criteria associated with at least the subset of the objects based at least in part on analysis of a context of at least the subset of the objects in the image, wherein the one or more inspection criteria correspond to one or more attributes of the objects in the subset; and
receiving publishing instructions that specify an audience and privacy settings for an application for use in conjunction with instances of a second electronic device, wherein the publishing instructions specify one or more recipients of the application, and
wherein the application is configured to perform analysis of one or more additional images based at least in part on the classifications and the one or more inspection criteria.

### Claim 2 (depends on 1)

The electronic device of claim 1, wherein the analysis of the image comprises one of:
providing the image intended for the computer; and
receiving object information associated with the computer, wherein the object information corresponds to the one or more objects; or
determining the object information by performing image analysis.

### Claim 3 (depends on 1)

The electronic device of claim 1, wherein the operations comprise receiving a revision to at least the subset of the objects; and
wherein the revision adds or removes an object from at least the subset of the objects.

### Claim 4 (depends on 1)

The electronic device of claim 1, wherein the operations comprise providing recommended classifications for the objects in the subset; and
wherein the received classifications for the objects in the subset are based at least in part on the recommended classifications.

### Claim 5 (depends on 4)

The electronic device of claim 4, wherein receiving the classifications comprises receiving acceptance of the recommended classifications.

### Claim 6 (depends on 4)

The electronic device of claim 4, wherein receiving the classifications comprises receiving revisions to the recommended classifications.

### Claim 7 (depends on 1)

The electronic device of claim 1, wherein the classifications comprise names for the objects in the subset.

### Claim 8 (depends on 1)

The electronic device of claim 1, wherein the one or more inspection criteria are determined based at least in part on provided questions associated with the one or more attributes and received answers associated with the one or more attributes.

### Claim 9 (depends on 8)

The electronic device of claim 8, wherein the received answers comprise a revision to at least one of the one or more attributes.

### Claim 10 (depends on 1)

The electronic device of claim 1, wherein the analysis of the context is performed on the electronic device, remotely by the computer or both.

### Claim 11 (depends on 1)

The electronic device of claim 1, wherein the one or more attributes comprise one or more of: a spatial arrangement of the objects in the subset, an order of the objects in the subset, a pattern corresponding to the objects in the subset, a number of the objects in the subset, one or more numerical values corresponding to the objects in the subset, or an orientation of the objects in the subset.

### Claim 12 (depends on 1)

The electronic device of claim 1, wherein the operations comprise receiving a revision to the one or more attributes.

### Claim 13 (depends on 1)

The electronic device of claim 1, wherein the operations comprise providing, using the interface circuit, the publishing instructions and the privacy settings intended for the computer.

### Claim 14 (depends on 1)

The electronic device of claim 1, wherein the operations comprise:
generating the application based at least in part on the classifications and the one or more inspection criteria; and
providing, using the interface circuit, the application intended for the computer.

### Claim 15

A non-transitory computer-readable storage medium for use in conjunction with an electronic device, the computer-readable storage medium storing program instructions that, when executed by the electronic device, causes the electronic device to perform operations comprising:
displaying a current field of view of the image sensor;
in response to an image-acquisition input, acquiring the image using the image sensor;
identifying and selecting at least a subset of the objects based at least in part on analysis of the image;
receiving classifications for objects in the subset;
determining one or more inspection criteria associated with at least the subset of the objects based at least in part on analysis of a context of at least the subset of the objects in the image, wherein the one or more inspection criteria correspond to one or more attributes of the objects in the subset; and
receiving publishing instructions that specify an audience and privacy settings for an application for use in conjunction with instances of a second electronic device, wherein the publishing instructions specify one or more recipients of the application, and
wherein the application is configured to perform analysis of one or more additional images based at least in part on the classifications and the one or more inspection criteria.

### Claim 16 (depends on 15)

The non-transitory computer-readable storage medium of claim 15, wherein the operations comprise receiving a revision to at least the subset of the objects; and
wherein the revision adds or removes an object from at least the subset of the objects.

### Claim 17 (depends on 15)

The non-transitory computer-readable storage medium of claim 15, wherein the operations comprise providing recommended classifications for the objects in the subset; and
wherein the received classifications for the objects in the subset are based at least in part on the recommended classifications.

### Claim 18 (depends on 15)

The non-transitory computer-readable storage medium of claim 15, wherein the one or more inspection criteria are determined based at least in part on provided questions associated with the one or more attributes and received answers associated with the one or more attributes.

### Claim 19 (depends on 15)

The non-transitory computer-readable storage medium of claim 15, wherein the one or more attributes comprise one or more of: a spatial arrangement of the objects in the subset, an order of the objects in the subset, a pattern corresponding to the objects in the subset, a number of the objects in the subset, one or more numerical values corresponding to the objects in the subset, or an orientation of the objects in the subset.

### Claim 20

A method for specifying or determining information associated with an application, comprising:
by an electronic device:
displaying a current field of view of the image sensor;
in response to an image-acquisition input, acquiring the image using the image sensor;
identifying and selecting at least a subset of the objects based at least in part on analysis of the image;
receiving classifications for objects in the subset;
determining one or more inspection criteria associated with at least the subset of the objects based at least in part on analysis of a context of at least the subset of the objects in the image, wherein the one or more inspection criteria correspond to one or more attributes of the objects in the subset; and
receiving publishing instructions that specify an audience and privacy settings for the application for use in conjunction with instances of a second electronic device, wherein the publishing instructions specify one or more recipients of the application, and
wherein the application is configured to perform analysis of one or more additional images based at least in part on the classifications and the one or more inspection criteria.
