# US 2023/0274168 A1 · Quantifying the human-likeness of artificially intelligent agents using statistical methods and techniques

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0274168 A1
- Document ID: US20230274168A1
- Status: Published application
- Kind: A1
- Application number: 17/682,832
- Filed: 2022-02-28
- Published: 2023-08-31
- Earliest claimed: 2022-02-28
- Assignees: Advanced Micro Devices, Inc.; ATI Technologies ULC
- Applicants: Advanced Micro Devices, Inc.; Ati Technologies Ulc
- Inventors: Ian Charles COLBERT; Mehdi SAEEDI; Gabor SINES; Thomas Daniel PERRY
- Web page: https://patentgrep.com/patent/US20230274168A1

## CPC

- G06N 5/043: Distributed expert systems; Blackboards
- G06F 16/90332: {Natural language query formulation or dialogue systems}
- G06N 3/006: based on simulated virtual individual or collective life forms, e.g. social simulations or particle swarm optimisation [PSO]
- G06N 3/092: Reinforcement learning
- G06N 3/0985: Hyperparameter optimisation; Meta-learning; Learning-to-learn
- G06N 7/01: Probabilistic graphical models, e.g. probabilistic networks
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

An apparatus includes a processor configured to determine a first distribution associated with an artificial agent based on behavior associated with the artificial agent and a second distribution based on behavior of a user. The processor is further configured to generate a human-likeness similarity measurement by comparing the first distribution to the second distribution and modify the behavior of the artificial agent in response to the similarity measurement failing to satisfy a similarity threshold.

## Claims

### Claim 1

A method comprising:
determining, at a processor, a first distribution based on behavior associated with an artificial agent and a second distribution based on behavior associated with a user;
generating, at the processor, a similarity measurement by comparing the first distribution to the second distribution, wherein the similarity measurement quantifies a human-likeness of the behavior associated with the artificial agent; and
responsive to the similarity measurement failing to meet a similarity threshold, modifying, at the processor, the behavior of the artificial agent based on the similarity measurement.

### Claim 2 (depends on 1)

The method of claim 1, wherein determining the first distribution and the second distribution comprises:
vectorizing a first set of behavior information to generate a first plurality of vectors, wherein each vector of the first plurality of vectors represents a different subsequence of behavior from the first set of behavior information; and
vectorizing a second set of behavior information to generate a second plurality of vectors, wherein each vector of the second plurality of vectors represents a different subsequence of behavior from the second set of behavior information.

### Claim 3 (depends on 2)

The method of claim 2, wherein determining the first distribution and the second distribution further comprises:
transforming the first plurality of vectors into a first plurality of visual representations and the second plurality of vectors into a second plurality of visual representations.

### Claim 4 (depends on 2)

The method of claim 2, wherein the first distribution comprises the first plurality of vectors and the second distribution the second plurality of vectors.

### Claim 5 (depends on 3)

The method of claim 3, wherein the first distribution comprises the first plurality of visual representations and the second distribution comprises the second plurality of visual representations.

### Claim 6 (depends on 1)

The method of claim 1, wherein generating the similarity measurement by comparing the first distribution to the second distribution comprises performing a two-sample hypothesis test.

### Claim 7 (depends on 6)

The method of claim 6, wherein performing the two-sample hypothesis test comprises:
operating in a first mode comprising
evaluating over the first distribution and the second distribution separately to generate a first distribution of distances; and
generating a test statistic based on the first distribution of distances;
operating in a second mode comprising
combining the first distribution and the second distribution to generate a pooled sample distribution of behaviors; and
evaluating over the pooled sample distribution to generate a second distribution of distances; and
generating the similarity measurement based on the test statistic and the second distribution of distances.

### Claim 8 (depends on 7)

The method of claim 7, wherein evaluating over the first distribution and the second distribution separately comprises:
for a given number of iterations, independently drawing a first subsample of a given size from the first distribution with replacement and a second subsample of the given size from the second distribution with replacement;
determining, for each iteration, a statistical distance between the first subsample and the second subsample; and
generating the first distribution of distances based on each statistical distance determined for each iteration.

### Claim 9 (depends on 8)

The method of claim 8, wherein the test statistic is generated according to:
δ=quantile(δX,Y,α) where α∈(0,1), where δ is the test statistic, δX,Y is the first distribution of distances, a is a hyperparameter for controlling a sensitivity of the two-sample hypothesis test, and
quantile(δX,Y,α) returns the α-th quantile over the first distribution of distances.

### Claim 10 (depends on 8)

The method of claim 8, wherein evaluating over the pooled sample distribution to generate a second distribution of distances comprises:
for the given number of iterations, independently drawing a third subsample of the given size from the pooled sample distribution with replacement and a fourth subsample of the given size from the pooled sample distribution;
determining, for each iteration, a statistical distance between the third subsample and the fourth subsample; and
generating the second distribution of distances based on each statistical distance determined for each iteration.

### Claim 11 (depends on 10)

The method of claim 10, wherein the similarity measurement is generated as a percentage of the distances in the second distribution of distances with a distance that is greater than the test statistic.

### Claim 12 (depends on 1)

The method of claim 1, wherein modifying the artificial agent based on the similarity measurement modifies one or more behaviors of the artificial agent.

### Claim 13

An apparatus comprising:
a processor configured to:
determine a first distribution based on a behavior associated with an artificial agent and a second distribution based on a behavior associated with a user;
generate a similarity measurement by comparing the first distribution to the second distribution, wherein the similarity measurement quantifies a human-likeness of the behavior associated with the artificial agent; and
responsive to the similarity measurement failing to meet a similarity threshold, modify the behavior of the artificial agent based on the similarity measurement.

### Claim 14 (depends on 13)

The apparatus of claim 13, wherein the processor is configured to generate the similarity measurement by:
operating in a first mode comprising
evaluating over the first distribution and the second distribution separately to generate a first distribution of distances; and
generating a test statistic based on the first distribution of distances;
operating in a second mode comprising
combining the first distribution of behavior and the second distribution of behavior to generate a pooled sample distribution of behaviors; and
evaluating over the pooled sample distribution to generate a second distribution of distances; and
generating the similarity measurement based on the test statistic and the second distribution of distances.

### Claim 15 (depends on 14)

The apparatus of claim 14, wherein the processor is configured to evaluate over the first distribution and the second distribution separately by:
for a given number of iterations, independently drawing a first subsample of a given size from the first distribution with replacement and a second subsample of the given size from the second distribution with replacement;
determining, for each iteration, a statistical distance between the first subsample and the second subsample; and
generating the first distribution of distances based on each statistical distance determined for each iteration.

### Claim 16 (depends on 15)

The apparatus of claim 15, wherein the processor is configured to evaluate over the pooled sample distribution to generate a second distribution of distances by:
for the given number of iterations, independently drawing a third subsample of the given size from the pooled sample distribution with replacement and a fourth subsample of the given size from the pooled sample distribution;
determining, for each iteration, a statistical distance between the third subsample and the fourth subsample; and
generating the second distribution of distances based on each statistical distance determined for each iteration.

### Claim 17 (depends on 15)

The apparatus of claim 15, wherein the processor is configured to generate the similarity measurement as a percentage of the distances in the second distribution of distances with a distance that is greater than the test statistic.

### Claim 18

A method comprising:
determining a first distribution based on behavior associated with a first artificial agent and a second distribution based on behavior associated with a second artificial agent;
generating a similarity measurement by comparing the first distribution to the second distribution, wherein the similarity measurement quantifies a similarity between the behavior of the first artificial agent and the behavior of the second artificial agent; and
modifying, based on the similarity measurement, at least one of the behavior of the first artificial agent or the behavior of the second artificial agent.

### Claim 19 (depends on 18)

The method of claim 18, wherein the behavior of the first artificial agent is represented by a first episode defined as a first sequence of behaviors spanning an initial state to a terminal state of the first artificial agent, and wherein the behavior of the second artificial agent is represented by a second episode defined as a second sequence of behaviors spanning an initial state to a terminal state of the second artificial agent.

### Claim 20 (depends on 19)

The method of claim 19, wherein determining the first distribution and the second distribution comprises:
sampling a first plurality of trajectories from the first episode, wherein each trajectory of the first plurality of trajectories is a subsequence of the first sequence of behaviors;
sampling a second plurality of trajectories from the second episode, wherein each trajectory of the second plurality of trajectories is a subsequence of the second sequence of behaviors;
vectorizing each sample trajectory of the first plurality of trajectories to generate a first plurality of vectors; and
vectorizing each sample trajectory of the second plurality of trajectories to generate a second plurality of vectors,
wherein the first distribution of behavior is determined based on the first plurality of vectors and the second distribution is determined based on the second plurality of vectors.
