# US 2023/0069285 A1 · Cognitive scrum master assistance interface for developers

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0069285 A1
- Document ID: US20230069285A1
- Status: Published application
- Kind: A1
- Application number: 17/406,366
- Filed: 2021-08-19
- Published: 2023-03-02
- Earliest claimed: 2021-08-19
- Assignees: Bank of America Corporation
- Applicants: Bank of America Corporation
- Inventors: Tamilselvi Elango; Karthikeyan Janakiraman
- Web page: https://patentgrep.com/patent/US20230069285A1

## CPC

- G06Q 10/101: Collaborative creation, e.g. joint development of products or services
- G06F 40/56: Natural language generation
- G06N 3/006: based on simulated virtual individual or collective life forms, e.g. social simulations or particle swarm optimisation [PSO]
- G06N 3/044: Recurrent networks, e.g. Hopfield networks
- G06N 3/0455: Auto-encoder networks; Encoder-decoder networks
- G06N 3/08: Learning methods
- G06N 3/092: Reinforcement learning
- G06Q 10/06313: {Resource planning in a project environment}
- G06Q 10/0637: Strategic management or analysis, e.g. setting a goal or target of an organisation; Planning actions based on goals; Analysis or evaluation of effectiveness of goals
- G06Q 10/103: {Workflow collaboration or project management}
- G06F 40/30: Semantic analysis
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS

## Abstract

Apparatus and methods for producing a product. The method may include receiving from a development assistance platform: a plurality of natural language state text segments; and a plurality of natural language action text segments. The method may include deriving for each of the plurality of natural language state text segments a state vector. The method may include deriving for each of the plurality of natural language action text segments an action vector. The method may include selecting, based on the state text segments, from the action vectors, an action vector corresponding to a past reward. The method may include designating a current reward based on the action vector. The method may include transmitting a directive to a development resource. The method may include deriving for the directive a directive vector. The method may include providing the directive vector to the platform.

## Claims

### Claim 1

Apparatus for producing a product, the apparatus comprising:
a bidirectional recurrent neural network encoder-decoder;
a reinforcement learning engine configured to:
receive from the encoder-decoder:
a state vector; and
an action vector;
determine a directive based on:
the state vector; and
the action vector;
identify a complexity error condition in the directive;
identify a coherence error condition in the directive;
receive a human-based reward; and
return the directive and the human-based reward to the encoder-decoder.

### Claim 2 (depends on 1)

The apparatus of claim 1 wherein the bidirectional recurrent neural network encoder-decoder is configured to incorporate into a neural network the human-based reward.

### Claim 3 (depends on 2)

The apparatus of claim 2 wherein the learning engine is configured to evaluate the action vector based on a reward matrix developed from output from the neural network.

### Claim 4 (depends on 3)

The apparatus of claim 3 wherein:
the action vector is an observed action vector; and
the learning engine is configured to evaluate the observed action vector by determining a difference in the matrix between:
a first reward based on the observed action vector; and
a second reward based on a preferred action vector derived from the matrix prior to receipt of the observed action vector.

### Claim 5 (depends on 1)

The apparatus of claim 1 wherein:
the reinforcement learning engine is further configured to transmit the directive to a development resource; and
the development resource is a scrum board.

### Claim 6 (depends on 1)

The apparatus of claim 1 wherein:
the reinforcement learning engine is further configured to transmit the directive to a development resource; and
the development resource is a product development team member.

### Claim 7

A method for producing a product, the method comprising:
receiving from a development assistance platform:
a plurality of natural language state text segments; and
a plurality of natural language action text segments;
deriving for each of the plurality of natural language state text segments a state vector;
deriving for each of the plurality of natural language action text segments an action vector;
selecting, based on the state text segments, from the action vectors, an action vector corresponding to a past reward;
designating a current reward based on the action vector;
transmitting a directive to a development resource;
deriving for the directive a directive vector; and
providing the directive vector to the platform.

### Claim 8 (depends on 7)

The method of claim 7 wherein the directive includes a mistake correction based on a proposed development action.

### Claim 9 (depends on 7)

The method of claim 7 wherein the directive includes predictive advice based on the state text segments.

### Claim 10 (depends on 7)

The method of claim 7 wherein the deriving includes formulating a generic response corresponding to the action.

### Claim 11 (depends on 10)

The method of claim 10 wherein the formulating includes mapping the action to one of a plurality of pre-selected generic responses.

### Claim 12 (depends on 11)

The method of claim 11 wherein the mapping includes choosing from the plurality of pre-selected generic responses the pre-selected generic response that is most likely to cause the action.

### Claim 13 (depends on 7)

The method of claim 7 wherein the reward includes a machine-determined reward component that is based on historical data.

### Claim 14 (depends on 13)

The method of claim 13 wherein the reward further includes a human-determined reward component.

### Claim 15 (depends on 7)

The method of claim 7 further comprising:
generating, from the state text segments, a prediction of the action;
comparing the action to the prediction; and
rejecting the action based on the comparing.

### Claim 16

A method for producing a product, the method comprising:
receiving from a development assistance platform natural language text segments;
deriving, using natural language understanding (“NLU”), from the text segments:
a state vector; and
an observed action vector;
formulating, based on the state, a preferred vector action;
determining a difference between the observed action vector and the preferred action vector;
selecting, based on the difference, an assistance mode from the group consisting of: mistake correcting; and predictive advising;
determining a directive vector based on the assistance mode;
converting the directive vector, using natural language generation (“NLG”), to directive text;
communicating the directive text to a development resource;
providing the directive vector to the platform;
receiving a human reward based on the directive text; and
transmitting the reward to the platform.

### Claim 17 (depends on 16)

The method of claim 16 further comprising prior to the communicating, performing a complexity analysis on the directive text.

### Claim 18 (depends on 16)

The method of claim 16 further comprising prior to the communicating, performing a coherence analysis on the directive text.

### Claim 19 (depends on 16)

The method of claim 16 further comprising formulating a reward matrix based on:
a plurality of state vectors; and
a plurality of actions, each action associated with one of the state vectors.

### Claim 20 (depends on 19)

The method of claim 19 wherein the determining includes quantifying:
a first reward based on the observed action; and
a second reward based on the preferred action.

### Claim 21 (depends on 20)

The method of claim 20 further comprising computing the second reward using a recurring neural network that includes the human reward.
