# US 2021/0174808 A1 · Interactive selection and modification

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0174808 A1
- Document ID: US20210174808A1
- Status: Published application
- Kind: A1
- Application number: 16/702,632
- Filed: 2019-12-04
- Published: 2021-06-10
- Earliest claimed: 2019-12-04
- Assignees: International Business Machines Corporation
- Applicants: International Business Machines Corporation
- Inventors: John J. Auvenshine; Jason LaScola; Michael Flores; Marci Devorah Formato; Ramesh Babu Kothamasu; Vidula M Patel
- Web page: https://patentgrep.com/patent/US20210174808A1

## CPC

- G10L 15/26: Speech to text systems (G10L15/08 takes precedence)
- H04L 51/10: Multimedia information
- G10L 15/063: {Training}
- G10L 15/08: Speech classification or search
- H04L 12/1827: {Network arrangements for conference optimisation or adaptation}
- H04L 51/066: Format adaptation, e.g. format conversion or compression
- G10L 13/00: Speech synthesis; Text to speech systems
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)

## Abstract

A method, system, and program product for selecting software is provided. The method includes retrieving audio data during a call with a subject matter expert (SME). The audio data is converted into a data training set and documents of the SME are converted into a document training set. Canonical documents generated by authors are analyzed and specified code is extracted from the text data training set and document training set. Attributes of individuals are detected. The attributes are compared with specified data and the canonical documents and it is determined that the individuals are requesting information associated with the text data. The information is provided to the individuals via the canonical documents or the documents of the SME and it is determined if a matched set of data exists between the attributes, the specified data, and the canonical documents. A digital action associated with results of the determination is executed.

## Claims

### Claim 1

An interactive software selection and modification method comprising:
retrieving, by a processor of a hardware device via a sensor of said hardware device, audio data retrieved during a conference call with a subject matter expert (SME);
converting, by said processor, said audio data into a text data training set;
converting, by said processor, informal documents of said SME into a document training set;
analyzing, by said processor, canonical documents generated by a plurality of alternative authors;
extracting, by said processor from said text data training set and said document training set, specified data and associated code;
retrieving, by said processor, additional text data converted from audio data of a plurality of individuals;
detecting, by said processor via a plurality of sensors, attributes of said plurality of individuals with respect to said additional text data;
comparing, by said processor, said attributes with specified data and said canonical documents;
first determining, by said processor, that said plurality of individuals are requesting information associated with said text data;
providing, by said processor based on results of said first determining, said information to said plurality of individuals via said canonical documents or said informal documents of said SME and transcripts of conference calls of the SME;
determining, by said processor based on results of said comparing, if a matched set of data exists between said attributes and said specified data and said canonical documents; and
executing, by said processor, a digital action associated with results of said determining.

### Claim 2 (depends on 1)

The method of claim 1, wherein said results of said determining indicate that a matched set of data exists between said attributes and said specified data and said canonical documents, and wherein said executing said digital action comprises:
presenting specified data of said text data training set or said document training set.

### Claim 3 (depends on 1)

The method of claim 1, wherein said results of said determining indicate that a matched set of data does not exist between said attributes and said specified data and said canonical documents, and wherein said executing said digital action comprises:
presenting a dataset of said text data training set or said document training set.

### Claim 4 (depends on 1)

The method of claim 1, wherein said results of said determining indicate that a matched set of data does not exist between said attributes and said specified data and said canonical documents, and wherein said executing said digital action comprises:
presenting a dataset of said canonical documents.

### Claim 5 (depends on 1)

The method of claim 1, wherein said results of said determining indicate that a matched set of data does not exist between said attributes and said specified data and said canonical documents, and wherein said executing said digital action comprises:
indicating a conflict between said specified data and said canonical documents;
presenting a dataset of said canonical documents and said specified data.

### Claim 6 (depends on 1)

The method of claim 1, further comprising:
receiving, by said processor from a user, feedback associated with said action.

### Claim 7 (depends on 1)

The method of claim 1, further comprising:
generating, by said processor, a digital report and associated computer code associated with said executing said action.

### Claim 8 (depends on 1)

The method of claim 1, further comprising:
integrating, by said processor, said action with a GUI with respect to virtual functionality.

### Claim 9 (depends on 1)

The method of claim 1, further comprising:
converting, by said processor, results of said executing said action into a second language differing from a language of said specified data and said canonical documents.

### Claim 10 (depends on 1)

The method of claim 1, further comprising:
modifying, by said processor based on said specified data and said canonical documents, software code for executing future processes associated with said interactive software selection and modification method.

### Claim 11 (depends on 1)

The method of claim 1, further comprising:
providing at least one support service for at least one of creating, integrating, hosting, maintaining, and deploying computer-readable code in the control hardware, said code being executed by the computer processor to implement: said retrieving, said converting said audio data, said converting said informal documents, said analyzing, said extracting, said detecting, said comparing, said first determining, said providing, said determining, said executing.

### Claim 12

A computer program product, comprising a computer readable hardware storage device storing a computer readable program code, said computer readable program code comprising an algorithm that when executed by a processor of hardware device implements an interactive software selection and modification method, said method comprising:
retrieving, by said processor via a sensor of said hardware device, audio data retrieved during a conference call with a subject matter expert (SME);
converting, by said processor, said audio data into a text data training set;
converting, by said processor, informal documents of said SME into a document training set;
analyzing, by said processor, canonical documents generated by a plurality of alternative authors;
extracting, by said processor from said text data training set and said document training set, specified data and associated code;
retrieving, by said processor, additional text data converted from audio data of a plurality of individuals;
detecting, by said processor via a plurality of sensors, attributes of said plurality of individuals with respect to said additional text data;
comparing, by said processor, said attributes with specified data and said canonical documents;
first determining, by said processor, that said plurality of individuals are requesting information associated with said text data;
providing, by said processor based on results of said first determining, said information to said plurality of individuals via said canonical documents or said informal documents of said SME and transcripts of conference calls of the SME;
determining, by said processor based on results of said comparing, if a matched set of data exists between said attributes and said specified data and said canonical documents; and
executing, by said processor, a digital action associated with results of said determining.

### Claim 13 (depends on 12)

The computer program product of claim 12, wherein said results of said determining indicate that a matched set of data exists between said attributes and said specified data and said canonical documents, and wherein said executing said digital action comprises:
presenting specified data of said text data training set or said document training set.

### Claim 14 (depends on 12)

The computer program product of claim 12, wherein said results of said determining indicate that a matched set of data does not exist between said attributes and said specified data and said canonical documents, and wherein said executing said digital action comprises:
presenting a dataset of said text data training set or said document training set.

### Claim 15 (depends on 12)

The computer program product of claim 12, wherein said results of said determining indicate that a matched set of data does not exist between said attributes and said specified data and said canonical documents, and wherein said executing said digital action comprises:
presenting a dataset of said canonical documents.

### Claim 16 (depends on 12)

The computer program product of claim 12, wherein said results of said determining indicate that a matched set of data does not exist between said attributes and said specified data and said canonical documents, and wherein said executing said digital action comprises:
indicating a conflict between said specified data and said canonical documents;
presenting a dataset of said canonical documents and said specified data.

### Claim 17 (depends on 12)

The computer program product of claim 12, wherein said method further comprises:
receiving, by said processor from a user, feedback associated with said action.

### Claim 18 (depends on 12)

The computer program product of claim 12, wherein said method further comprises:
generating, by said processor, a digital report and associated computer code associated with said executing said action.

### Claim 19 (depends on 12)

The computer program product of claim 12, wherein said method further comprises:
integrating, by said processor, said action with an interface with respect to virtual functionality.

### Claim 20

A hardware device comprising a processor coupled to a computer-readable memory unit, said memory unit comprising instructions that when executed by the processor implements an interactive software selection and modification method comprising:
retrieving, by said processor via a sensor of said hardware device, audio data retrieved during a conference call with a subject matter expert (SME);
converting, by said processor, said audio data into a text data training set;
converting, by said processor, informal documents of said SME into a document training set;
analyzing, by said processor, canonical documents generated by a plurality of alternative authors;
extracting, by said processor from said text data training set and said document training set, specified data and associated code;
retrieving, by said processor, additional text data converted from audio data of a plurality of individuals;
detecting, by said processor via a plurality of sensors, attributes of said plurality of individuals with respect to said additional text data;
comparing, by said processor, said attributes with specified data and said canonical documents;
first determining, by said processor, that said plurality of individuals are requesting information associated with said text data;
providing, by said processor based on results of said first determining, said information to said plurality of individuals via said canonical documents or said informal documents of said SME and transcripts of conference calls of the SME;
determining, by said processor based on results of said comparing, if a matched set of data exists between said attributes and said specified data and said canonical documents; and
executing, by said processor, a digital action associated with results of said determining.
