# US 2023/0054850 A1 · Techniques for intuitive machine learning development and optimization

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0054850 A1
- Document ID: US20230054850A1
- Status: Published application
- Kind: A1
- Application number: 17/832,776
- Filed: 2022-06-06
- Published: 2023-02-23
- Earliest claimed: 2020-12-30
- Assignees: Hyland UK Operations Limited
- Applicants: Hyland UK Operations Limited
- Inventors: Tiago Filipe Dias Cardoso; Pedro Miguel Dias Cardoso; Gethin Paul James; Isabel Maria Malheiro de Oliveira Novais Machado; Andrei Nechaev
- Web page: https://patentgrep.com/patent/US20230054850A1

## CPC

- G06N 20/00: Machine learning
- G06N 5/04: Inference or reasoning models
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS

## Abstract

Various embodiments are generally directed to techniques for intuitive machine learning (ML) development and optimization, such as for application in a content services platform (CSP), for instance. Many embodiments include a ML model developer and a ML model evaluator to provide a graphical user interface that guides ML layman in developing, evaluating, implementing, managing, and/or optimizing ML models. Some embodiments are particularly directed to a common interface that provides a step-by-step user experience to develop and implement ML techniques. For example, embodiments may include computing a health score for various aspects of developing and/or optimizing ML models, and using the health score, and the factors contributing thereto, to guide production of a valuable ML model. These and other embodiments are described and claimed.

## Claims

### Claim 1

An apparatus, the apparatus comprising:
a processor; and
a memory comprising instructions that when executed by the processor cause the processor to:
present, via a graphical user interface (GUI), a plurality of data sets available for development of machine learning (ML) models, wherein each data set comprises a plurality of samples;
identify, based on input received via the GUI, a data set of the plurality of data sets for development of a ML model;
determine a plurality of characteristics associated with each sample in the data set identified, wherein a value for each of the plurality of characteristics is assignable to each sample in the data set identified;
compute a health of each characteristic in the plurality of characteristics, wherein health of a respective characteristic indicates a predictability of values for the respective characteristic;
present, via the GUI, the plurality of characteristics associated with the data set and the health of each of the plurality of characteristics;
identify, based on input received via the GUI, a target characteristics to predict values for; and
develop the ML model to predict values for the target characteristic.

### Claim 2 (depends on 1)

The apparatus of claim 1 the memory comprising instructions that when executed by the processor cause the processor to:
determine an action to improve the health of a characteristic of the plurality of characteristics; and
present the action to improve the health of the characteristic via the GUI.

### Claim 3 (depends on 2)

The apparatus of claim 2, wherein the action to improve the health of the characteristic comprises one or more of adding samples to the data set identified and assigning values for the characteristic to one or more samples.

### Claim 4 (depends on 1)

The apparatus of claim 1, the memory comprising instructions that when executed by the processor cause the processor to compute the health of each characteristic in the plurality of characteristics with a ML algorithm.

### Claim 5 (depends on 1)

The apparatus of claim 1, the memory comprising instructions that when executed by the processor cause the processor to:
compute a health of each data set in the plurality of data sets, wherein health of a respective data set indicates a potential for training an accurate ML model based on the respective data set; and
present, via the GUI, the plurality of data sets available for development of machine learning (ML) models and the health of each of the plurality of data sets.

### Claim 6 (depends on 5)

The apparatus of claim 5, the memory comprising instructions that when executed by the processor cause the processor to:
determine an issue with the data set of the plurality of data sets to compute a health of the data set; and
present, via the GUI, the issue with the data set.

### Claim 7 (depends on 6)

The apparatus of claim 6, wherein the issue with the data set comprises insufficient samples in the data set.

### Claim 8 (depends on 1)

The apparatus of claim 1, the memory comprising instructions that when executed by the processor cause the processor to:
determine a set of candidate characteristics based on the target characteristic;
compute a health of each candidate characteristic, wherein health of a respective candidate characteristic indicates potential to be a predictor for the target characteristic; and
present, via the GUI, the set of candidate characteristics and the health of each of the candidate characteristics.

### Claim 9 (depends on 8)

The apparatus of claim 8, the memory comprising instructions that when executed by the processor cause the processor to:
identify, based on input received via the GUI, a set of predictor characteristics to utilize in prediction of values for the target characteristic; and
develop the ML model to predict values for the target characteristic based on values for the set of predictor characteristics.

### Claim 10 (depends on 9)

The apparatus of claim 9, the memory comprising instructions that when executed by the processor cause the processor to:
determine an action to improve the health of a candidate characteristic in the set of candidate characteristics; and
present the action to improve the health of the candidate characteristic via the GUI.

### Claim 11 (depends on 10)

The apparatus of claim 10, wherein the action to improve the health of the characteristic comprises assigning values for the characteristic to one or more samples.

### Claim 12

At least one non-transitory computer-readable medium comprising a set of instructions that, in response to being executed by a processor circuit, cause the processor circuit to:
present, via a graphical user interface (GUI), a plurality of data sets available for development of machine learning (ML) models, wherein each data set comprises a plurality of samples;
identify, based on input received via the GUI, a data set of the plurality of data sets for development of a ML model;
determine a plurality of characteristics associated with each sample in the data set identified, wherein a value for each of the plurality of characteristics is assignable to each sample in the data set identified;
compute a health of each characteristic in the plurality of characteristics, wherein health of a respective characteristic indicates a predictability of values for the respective characteristic;
present, via the GUI, the plurality of characteristics associated with the data set and the health of each of the plurality of characteristics;
identify, based on input received via the GUI, a target characteristics to predict values for; and
develop the ML model to predict values for the target characteristic.

### Claim 13 (depends on 12)

The at least one non-transitory computer-readable medium of claim 12, comprising instructions that, in response to being executed by the processor circuit cause the processor circuit to:
determine an issue with a characteristic of the plurality of characteristics to compute a health of the characteristic; and
present the issue with the characteristic via the GUI.

### Claim 14 (depends on 13)

The at least one non-transitory computer-readable medium of claim 13, wherein the issue with the characteristic comprises one or more of insufficient samples in the data set and insufficient values in the samples for the characteristic.

### Claim 15 (depends on 14)

The at least one non-transitory computer-readable medium of claim 14, comprising instructions that, in response to being executed by the processor circuit cause the processor circuit to:
determine a possible solution to the issue with the characteristic; and
present the possible solution to the issue via the GUI.

### Claim 16 (depends on 15)

The at least one non-transitory computer-readable medium of claim 15, wherein the possible solution to the issue comprises one or more of adding samples to the data set identified and assigning values for the characteristic to one or more samples.

### Claim 17 (depends on 16)

The at least one non-transitory computer-readable medium of claim 16, comprising instructions that, in response to being executed by the processor circuit cause the processor circuit to present, via the GUI, a link to add samples to the data set identified or assign values for the characteristic to one or more samples.

### Claim 18

A computer-implemented method, comprising:
presenting, via a graphical user interface (GUI), a plurality of data sets available for development of machine learning (ML) models, wherein each data set comprises a plurality of samples;
identifying, based on input received via the GUI, a data set of the plurality of data sets for development of an ML model;
determining a plurality of characteristics associated with each sample in the data set identified, wherein a value for each of the plurality of characteristics is assignable to each sample in the data set identified; and
computing a health of each characteristic in the plurality of characteristics, wherein health of a respective characteristic indicates a predictability of values for the respective characteristic.

### Claim 19 (depends on 18)

The computer-implemented method of claim 18, comprising:
presenting, via the GUI, the plurality of characteristics associated with the data set and the health of each of the plurality of characteristics;
identifying, based on input received via the GUI, a target characteristic to predict values for; and
developing the ML model to predict values for the target characteristic.

### Claim 20 (depends on 19)

The computer-implemented method of claim 19, comprising:
determining a set of candidate characteristics based on the target characteristic;
computing a health of each candidate characteristic, wherein health of a respective candidate characteristic indicates potential to be a predictor for the target characteristic; and
presenting, via the GUI, the set of candidate characteristics and the health of each of the candidate characteristics.
