# US 12,217,311 B2 · Dynamically generated object-responsive interactive action display

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,217,311 B2
- Document ID: US12217311B2
- Status: Granted
- Kind: B2
- Application number: 17/819,590
- Filed: 2022-08-12
- Published: 2023-04-06
- Granted: 2025-02-04
- Earliest claimed: 2019-08-02
- Applicants: John F. Groom
- Inventors: John F. Groom
- Web page: https://patentgrep.com/patent/US12217311B2

## CPC

- G06Q 40/08: Insurance
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06F 3/04815: Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object
- G06F 3/0484: for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06F 9/541: {via adapters, e.g. between incompatible applications}
- G06F 16/2379: {Updates performed during online database operations; commit processing}
- G06F 16/245: Query processing
- G06Q 10/10: Office automation; Time management
- G06Q 30/012: Providing warranty services
- G06Q 30/0645: Rental transactions; Leasing transactions
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

Apparatus and associated methods related to generate at least one quotation request from records related to tangible property. In an illustrative embodiment, a signal corresponding to input from a user identifying a real environment is received. For example, the user may transmit a quotation request associated with the real environment. Based on the quotation request, for example, identify information related to the real environment based on predetermined requirements associated with at least one API related to a type of the request. For example, at least one second quotation request may be generated as a function of the information to a plurality of vendors through the at least one API. Various embodiments may perform virtual environment operations to present a plurality of records related to the real environment.

## Claims

### Claim 1

A system comprising:
a data store comprising a program of instructions; and,
a processor operably coupled to the data store such that, when the processor executes the program of instructions, the processor causes operations to be performed to generate at least one quotation request from records related to tangible property and stored across multiple data stores, the operations comprising:
in response to a user interacting with a user interface to select a representative object, the user interface displaying a virtual environment comprising a visual indicium of the representative object in the virtual environment, then retrieve, by the processor, the representative object from a first datastore, wherein the representative object comprises a predetermined data structure corresponding to a tangible object in a real environment, and wherein the virtual environment comprises an interactive map of the real environment;
determining, by the processor, attributes of the tangible object based on the representative object, the attributes comprising classification and historical events associated with the tangible object, wherein the historical events comprise a historical action performed with respect to the tangible object;
selecting, by the processor and based on the attributes, a plurality of application programming interfaces (APIs), each API corresponding to at least one action capable of being performed in relation to the tangible object, wherein selecting the plurality of APIs comprises selecting attributes for the tangible object by adaptive rules generated by a machine learning model from at least one user's historical behavior;
determining, by the processor and based on the plurality of APIs, a plurality of actions to associate with the representative object, and associating the actions;
generating and transmitting, by the processor and to the user interface, a signal configured to cause the user interface to generate an action display comprising at least one interactive visual indicium for each of the plurality of actions, wherein each interactive visual indicium is associated with at least one action of the plurality of actions and a corresponding at least one API of the plurality of APIs such that, the plurality of APIs are accessible through the user interface such that when the user selects the visual indicium, the corresponding at least one action is initiated for the corresponding at least one API as a function of at least some of the attributes, including the classification and the historical action, and associated with the representative object and the tangible object;
determine a required information set corresponding to the tangible object by the corresponding at least one API;
retrieve, based on the representative object, a first set of information corresponding to the tangible object;
determine if the first set of information satisfies the required information set;
upon determining that the first set of information does not satisfy the required information set, identify at least one supplementary API based on the attributes, and retrieve, via the at least one supplementary API, a second set of information; and,
upon determining that at least one of the first set of information and the second set of information satisfy the required information set, then continue the at least one action with the at least one API.

### Claim 2 (depends on 1)

The system of claim 1, wherein the visual indicium of the representative object comprises a multi-dimensional image of the object, and wherein the user interacting with the visual indicium corresponds to the user selecting the visual indicium.

### Claim 3 (depends on 1)

The system of claim 1, wherein the action display is displayed in visual association with the representative object.

### Claim 4 (depends on 1)

The system of claim 1, wherein the at least one action comprises retrieving documentation related to the tangible object.

### Claim 5 (depends on 1)

The system of claim 1, wherein the at least one action comprises requesting a quotation related to the tangible object.

### Claim 6 (depends on 1)

The system of claim 1, wherein the at least one action comprises locating at least one supplemental tangible object based on the attributes of the tangible object.

### Claim 7 (depends on 1)

The system of claim 1, further comprising the user interface.

### Claim 8

A computer program product embodied on at least one non-transitory computer readable medium comprising:
a program of instructions tangibly embodied on the at least one non-transitory computer readable medium, wherein when the instructions are executed on at least one processor, the at least one processor causes operations to be performed to generate at least one quotation request from records related to tangible property and stored across multiple data stores, the operations comprising:
in response to a user interacting with a user interface to select a representative object, the user interface displaying a virtual environment comprising a visual indicium of the representative object in the virtual environment, then retrieve, by the at least one processor, the representative object from a first datastore, wherein the representative object comprises a predetermined data structure corresponding to a tangible object in a real environment, and wherein the virtual environment comprises an interactive map of the real environment;
determining, by the at least one processor, attributes of the tangible object based on the representative object, the attributes comprising classification and historical events associated with the tangible object, wherein the historical events comprise a historical action performed with respect to the tangible object;
selecting, by the at least one processor and based on the attributes, a plurality of application programming interfaces (APIs), each API corresponding to at least one action capable of being performed in relation to the tangible object, wherein selecting the plurality of APIs comprises selecting attributes for the tangible object by adaptive rules generated by a machine learning model from at least one user's historical behavior;
determining, by the at least one processor and based on the plurality of APIs, a plurality of actions to associate with the representative object, and associating the actions;
generating and transmitting, by the at least one processor and to the user interface, a signal configured to cause the user interface to generate an action display comprising at least one interactive visual indicium for each of the plurality of actions, wherein each interactive visual indicium is associated with at least one action of the plurality of actions and a corresponding at least one API of the plurality of APIs, such that the plurality of APIs are accessible through the user interface such that, when the user selects the visual indicium, the corresponding at least one action is initiated for the corresponding at least one API as a function of at least some of the attributes, including the classification and the historical action, and associated with the representative object and the tangible object;
determine a required information set corresponding to the tangible object by the corresponding at least one API;
retrieve, based on the representative object, a first set of information corresponding to the tangible object;
determine if the first set of information satisfies the required information set;
upon determining that the first set of information does not satisfy the required information set, identify at least one supplementary API based on the attributes, and retrieve, via the at least one supplementary API, a second set of information; and
upon determining that at least one of the first set of information and the second set of information satisfy the required information set, then continue the at least one action with the at least one API.

### Claim 9 (depends on 8)

The computer program product of claim 8, wherein the visual indicium of the representative object comprises a multi-dimensional image of the object, and wherein the user interacting with the visual indicium corresponds to the user selecting the visual indicium.

### Claim 10 (depends on 8)

The computer program product of claim 8, wherein the action display is displayed in visual association with the representative object.

### Claim 11 (depends on 8)

The computer program product of claim 8, wherein the at least one action comprises retrieving documentation related to the tangible object.

### Claim 12 (depends on 8)

The computer program product of claim 8, wherein the at least one action comprises requesting a quotation related to the tangible object.

### Claim 13 (depends on 8)

The computer program product of claim 8, wherein the at least one action comprises locating at least one supplemental tangible object based on the attributes of the tangible object.

### Claim 14

A computer-implemented method performed by at least one processor to generate at least one quotation request from records related to tangible property and stored across multiple data stores, the method comprising:
in response to a user interacting with a user interface to select a representative object, the user interface displaying a virtual environment comprising a visual indicium of the representative object in the virtual environment, then retrieve the representative object from a first datastore, wherein the representative object comprises a predetermined data structure corresponding to a tangible object in a real environment, and wherein the virtual environment comprises an interactive map of the real environment;
determining attributes of the tangible object based on the representative object, the attributes comprising classification and historical events associated with the tangible object, wherein the historical events comprise a historical action performed with respect to the tangible object;
selecting, based on the attributes, a plurality of application programming interfaces (APIs), each API corresponding to at least one action capable of being performed in relation to the tangible object, wherein selecting the plurality of APIs comprises selecting attributes for the tangible object by adaptive rules generated by a machine learning model from at least one user's historical behavior;
determining, based on the plurality of APIs, a plurality of actions to associate with the representative object, and associating the actions;
generating and transmitting, to the user interface, a signal configured to cause the user interface to generate an action display comprising at least one interactive visual indicium for each of the plurality of actions, wherein each interactive visual indicium is associated with at least one action of the plurality of actions and a corresponding at least one API of the plurality of APIs, such that the plurality of APIs are accessible through the user interface such that, when the user selects the visual indicium, the corresponding at least one action is initiated for the corresponding at least one API as a function of at least some of the attributes, including the classification and the historical action, and associated with the representative object and the tangible object;
determine a required information set corresponding to the tangible object by the corresponding at least one API;
retrieve, based on the representative object, a first set of information corresponding to the tangible object;
determine if the first set of information satisfies the required information set;
upon determining that the first set of information does not satisfy the required information set, identify at least one supplementary API based on the attributes, and retrieve, via the at least one supplementary API, a second set of information; and,
upon determining that at least one of the first set of information and the second set of information satisfy the required information set, then continue the at least one action with the at least one API.

### Claim 15 (depends on 14)

The method of claim 14, wherein the action display is displayed in visual association with the representative object.

### Claim 16 (depends on 14)

The method of claim 14, wherein the real environment comprises real estate, and the tangible object comprises a specific physical object physically located within the real environment.

### Claim 17 (depends on 14)

The method of claim 14, wherein the historical event comprises an action performed to the tangible object.

### Claim 18 (depends on 14)

The method of claim 14, wherein the historical event comprises one or more of: a physical installation of the tangible object, a physical maintenance action to the tangible object; a physical alteration of the tangible object; a transaction respecting the tangible object; a registration of the tangible object; a service request for the tangible object; a quotation respecting the tangible object; a valuation of the tangible object; a document recordation associated with the tangible object; and some combination thereof.