# US 12,372,943 B2 · Generation of computer-executable instructions based on monitoring network communications of remote computing systems

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,372,943 B2
- Document ID: US12372943B2
- Status: Granted
- Kind: B2
- Application number: 18/906,819
- Filed: 2024-10-04
- Published: 2025-04-10
- Granted: 2025-07-29
- Earliest claimed: 2023-10-06
- Assignees: Starbucks Corporation
- Applicants: Starbucks Corporation
- Inventors: Ningyu Chen
- Web page: https://patentgrep.com/patent/US12372943B2

## CPC

- G05B 19/40937: {concerning programming of machining or material parameters, pocket machining}
- G06Q 30/0621: {by configuring or customising goods or services}
- G05B 13/0265: {the criterion being a learning criterion}
- G06N 3/0475: Generative networks
- G06N 20/00: Machine learning
- G05B 2219/32005: Graphical, text operator instructions synchronous with product distribution
- G05B: CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS (systems for controlling or regulating non-electric variables G05D; systems for regulating electric or magnetic variables G05F; control devices or systems insofar as characterised by mechanical features only G05G)
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS

## Abstract

The disclosure generally relates to a system for identifying a formula to build a customized object. The system may identify one or more attributes of an object based on monitoring remote computing systems. The system may provide a prompt to a computing system based on the identified one or more attributes and the computing system may provide an output indicative of a customized object. The system may identify a formula to build the customized object based on the output. The system may provide an output indicative of the formula and/or the customized object.

## Claims

### Claim 1

A computer-implemented method comprising:
monitoring one or more network communications of one or more remote computing systems, the one or more network communications associated with an object;
obtaining a first set of data based on monitoring the one or more network communications, wherein the first set of data indicates one or more first attributes;
determining a second set of data that is associated with the first set of data, wherein the second set of data is stored in a local data store, wherein the second set of data indicates one or more values of one or more second attributes associated with the object, and wherein the one or more first attributes are different from the one or more second attributes;
determining a compatibility of the first set of data and the second set of data;
generating a prompt based on the first set of data and the second set of data based on determining the compatibility of the first set of data and the second set of data;
providing the prompt to a first computing system;
obtaining an output from the first computing system based on providing the prompt to the first computing system, wherein the output indicates one or more adjustments to the one or more values of the one or more second attributes based on the one or more first attributes, and wherein the object is modified based on the output to obtain a modified object;
generating computer-executable instructions based on the output, wherein the computer-executable instructions indicate one or more of tag data, image data, or text data associated with the modified object; and
providing the computer-executable instructions to a second computing system, wherein the object is built based on the computer-executable instructions.

### Claim 2 (depends on 1)

The computer-implemented method of claim 1, further comprising:
obtaining location data associated with the one or more network communications, wherein the location data is indicative of a location; and
providing the location data to the second computing system.

### Claim 3 (depends on 1)

The computer-implemented method of claim 1, wherein monitoring the one or more network communications comprises one or more of:
monitoring a communication between a first remote computing system of the one or more remote computing systems and a second remote computing system of the one or more remote computing systems; or
monitoring a communication from a first remote computing system of the one or more remote computing systems to a server.

### Claim 4 (depends on 1)

The computer-implemented method of claim 1, wherein monitoring the one or more network communications comprises:
monitoring web traffic.

### Claim 5 (depends on 1)

The computer-implemented method of claim 1, further comprising:
instructing building of the object by a machine using the computer-executable instructions.

### Claim 6 (depends on 1)

The computer-implemented method of claim 1, further comprising:
obtaining, from a user computing device, a request to build the object; and
instructing building of the object by a machine using the computer-executable instructions based on the request.

### Claim 7 (depends on 1)

The computer-implemented method of claim 1, further comprising:
obtaining, from a user computing device, a request to build the object;
determining that a location associated with the request corresponds to a location associated with the computer-executable instructions; and
instructing building of the object by a machine using the computer-executable instructions based on determining that the location associated with the request corresponds to the location associated with the computer-executable instructions.

### Claim 8 (depends on 1)

The computer-implemented method of claim 1, further comprising:
based on generating the computer-executable instructions, providing an identifier of the object for selection;
obtaining, from a user computing device, an input, wherein the input indicates a selection of the identifier of the object; and
instructing building of the object by a machine using the computer-executable instructions in response to obtaining the input.

### Claim 9 (depends on 1)

The computer-implemented method of claim 1, further comprising:
obtaining first location data associated with the one or more network communications;
linking the computer-executable instructions to the first location data;
determining second location data associated with a user computing device;
determining that the second location data corresponds to the first location data;
based on determining that the second location data corresponds to the first location data, providing, to the user computing device, an identifier of the object for selection;
obtaining, from the user computing device, an input, wherein the input indicates a selection of the identifier of the object; and
instructing building of the object by a machine using the computer-executable instructions in response to obtaining the input.

### Claim 10 (depends on 1)

The computer-implemented method of claim 1, further comprising:
storing the computer-executable instructions in the local data store.

### Claim 11 (depends on 1)

The computer-implemented method of claim 1, wherein the computer-executable instructions comprise first computer-executable instructions, wherein the second set of data comprises second computer-executable instructions, wherein generating the computer-executable instructions comprises:
modifying the second computer-executable instructions to obtain the first computer-executable instructions.

### Claim 12 (depends on 1)

The computer-implemented method of claim 1, wherein execution of the computer-executable instructions causes output of one or more identifiers of one or more steps for building the object.

### Claim 13 (depends on 1)

The computer-implemented method of claim 1, wherein the first set of data is associated with one or more of a first version of the object or a first formula for the object, and wherein the second set of data is associated with one or more of a second version of the object or a second formula for the object.

### Claim 14 (depends on 1)

The computer-implemented method of claim 1, further comprising:
obtaining audio data based on monitoring the one or more network communications; and
performing audio-to-text conversion on the audio data, wherein obtaining the first set of data is further based on performing the audio-to-text conversion.

### Claim 15 (depends on 1)

The computer-implemented method of claim 1, further comprising:
obtaining image data based on monitoring the one or more network communications; and
performing optical character recognition on the image data, wherein obtaining the first set of data is further based on performing the optical character recognition.

### Claim 16 (depends on 1)

The computer-implemented method of claim 1, further comprising:
obtaining image data based on monitoring the one or more network communications; and
captioning the image data, wherein obtaining the first set of data is further based on captioning the image data.

### Claim 17 (depends on 1)

The computer-implemented method of claim 1, further comprising:
obtaining a third set of data based on monitoring the one or more network communications;
identifying one or more exposure thresholds; and
determining a subset of the third set of data is greater than or matches the one or more exposure thresholds, wherein the first set of data corresponds to the subset of the third set of data.

### Claim 18 (depends on 1)

The computer-implemented method of claim 1, wherein the first computing system comprises a machine learning model, wherein the prompt comprises a prompt for the machine learning model, wherein providing the prompt to the first computing system comprises:
providing the prompt to the machine learning model, wherein the output comprises an output of the machine learning model.

### Claim 19 (depends on 1)

The computer-implemented method of claim 1, further comprising:
providing the output to a machine learning model, the machine learning model trained to generate the tag data based on an input to the machine learning model; and
obtaining the tag data from the machine learning model, wherein the tag data comprises a keyword, a name, a description, an image, or a receipt associated with the object.

### Claim 20 (depends on 1)

The computer-implemented method of claim 1, further comprising:
providing the output to a machine learning model, the machine learning model trained to generate the image data based on an input to the machine learning model; and
obtaining the image data from the machine learning model, wherein a display is updated based on the image data.

### Claim 21 (depends on 1)

The computer-implemented method of claim 1, further comprising:
providing the output to a machine learning model, the machine learning model trained to generate the text data based on an input to the machine learning model; and
obtaining the text data from the machine learning model, wherein the text data comprises a training manual or educational material associated with the object.

### Claim 22 (depends on 1)

The computer-implemented method of claim 1, wherein the first set of data and the second set of data have different data formats.

### Claim 23 (depends on 1)

The computer-implemented method of claim 1, wherein the object comprises a customized object or an object with a customized flavor profile.

### Claim 24

A computer-implemented method comprising:
obtaining, from a first data source, a first set of data indicating one or more first attributes;
obtaining, from a second data source, a second set of data indicating one or more values of one or more second attributes associated with an object, wherein the one or more first attributes are different from the one or more second attributes;
determining a compatibility of the first set of data and the second set of data;
providing the first set of data and the second set of data to a computing system based on determining the compatibility of the first set of data and the second set of data;
receiving, from the computing system, an output based on providing the first set of data and the second set of data to the computing system, wherein the output identifies one or more adjustments to the one or more values of the one or more second attributes based on the one or more first attributes, and wherein the object is modified based on the output to obtain a modified object;
generating one or more of tag data associated with the modified object, image data associated with the modified object, or text data associated with the modified object;
storing the one or more of the tag data, the image data, or the text data in a data store; and
causing display, via a user interface of a computing device, of the one or more of the tag data, the image data, or the text data, wherein the modified object is built based on the output.

### Claim 25

A computing device comprising:
memory hardware storing first computer-executable instructions; and
at least one hardware processor, wherein execution of the first computer-executable instructions by the at least one hardware processor causes the at least one hardware processor to:
obtaining a set of data indicating one or more first attributes, wherein the set of data is associated with a first data format;
determining a compatibility of the set of data and an additional set of data;
providing the set of data to a computing system based on determining the compatibility of the set of data and the additional set of data;
obtaining a first output from the computing system based on providing the set of data to the computing system, wherein the first output identifies one or more adjustments to one or more values of one or more second attributes of an object based on the one or more first attributes, wherein the object is modified based on the first output to obtain a modified object, and wherein the one or more first attributes are different from the one or more second attributes;
identifying second computer-executable instructions to build the modified object based on the first output, wherein the second computer-executable instructions are associated with a second data format;
generating one or more of tag data associated with the modified object, image data associated with the modified object, or text data associated with the modified object; and
providing a second output indicative of at least one of the modified object or the second computer-executable instructions, wherein the second output comprises the one or more of the tag data, the image data, or the text data, and wherein the modified object is built based on the second output.