# US 2026/0017568 A1 · Device and method for generating multi-objective pareto policy set

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0017568 A1
- Document ID: US20260017568A1
- Status: Published application
- Kind: A1
- Application number: 19/266,132
- Filed: 2025-07-10
- Published: 2026-01-15
- Earliest claimed: 2024-07-11
- Assignees: Research & Business Foundation Sungkyunkwan University
- Applicants: Research & Business Foundation Sungkyunkwan University
- Inventors: Hong Uk WOO; Woo Kyung KIM; Min Jong YOO
- Web page: https://patentgrep.com/patent/US20260017568A1

## CPC

- G06N 20/00: Machine learning
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS

## Abstract

An embodiment of a method for generating multi-objective Pareto policy set comprises receiving a sample dataset, generating an imitation policy and a reward function of the imitation policy from the sample dataset, setting a target policy at a predetermined position near the imitation policy, fine-tuning the target policy based on a distance between the reward function of the imitation policy and the reward function of the target policy and generating a Pareto policy set including the imitation policy and the fine-tuned target policy.

## Claims

### Claim 1

A method for generating a Pareto policy set, the method comprising:
receiving a sample dataset;
generating an imitation policy and a reward function of the imitation policy from the sample dataset;
setting a target policy at a predetermined position near the imitation policy;
fine-tuning the target policy based on a distance between the reward function of the imitation policy and the reward function of the target policy; and
generating a Pareto policy set including the imitation policy and the fine-tuned target policy.

### Claim 2 (depends on 1)

The method for generating a Pareto policy set of claim 1,
wherein the generating an imitation policy and a reward function of the imitation policy comprises generating two imitation policies and two reward functions of the imitation policies, respectively, from each of the two sample datasets, and
wherein the setting a target policy comprises generating two target policies.

### Claim 3 (depends on 1)

The method for generating a Pareto policy set of claim 1,
wherein the imitation policy comprises a first imitation policy and a second imitation policy and the reward function of the imitation policy comprises a reward function of the first imitation policy and a reward function of the second imitation policy, and
wherein the fine-tuning the target policy comprises fine-tuning the target policy based on a distance between the reward function of the first imitation policy and the reward function of the target policy.

### Claim 4 (depends on 1)

The method for generating a Pareto policy set of claim 1,
wherein the imitation policy comprises a first imitation policy and a second imitation policy and the reward function of the imitation policy comprises a reward function of the first imitation policy and a reward function of the second imitation policy, and
wherein the fine-tuning the target policy comprises fine-tuning the target policy based on a distance between the reward function of the second imitation policy and the reward function of the target policy.

### Claim 5 (depends on 1)

The method for generating a Pareto policy set of claim 1,
wherein the imitation policy comprises a first imitation policy and a second imitation policy and a reward function of the imitation policy comprises a reward function of the first imitation policy and a reward function of the second imitation policy, and
wherein the fine-tuning the target policy comprises fine-tuning the target policy based on a distance between the reward function of the first imitation policy and the reward function of the second imitation policy.

### Claim 6 (depends on 1)

The method for generating a Pareto policy set of claim 1,
wherein the fine-tuning the target policy comprises generating a normalization term based on a distance between a reward function of the imitation policy and a reward function of the target policy and a distance between reward functions of the imitation policy, and fine-tuning the target policy by learning to maximize a reward function normalization equation including the generated normalization term.

### Claim 7 (depends on 1)

The method for generating a Pareto policy set of claim 1,
wherein in the setting a target policy, the predetermined position is located on a predetermined Pareto front extending between the imitation policies.

### Claim 8 (depends on 1)

The method for generating a Pareto policy set of claim 1, further comprising:
updating the fine-tuned target policies to the imitation policies when the distance between the reward functions of the fine-tuned target policies exceeds a predetermined distance.

### Claim 9 (depends on 1)

The method for generating a Pareto policy set of claim 1,
wherein the generating a Pareto policy set comprises generating the Pareto policy set when a distance between reward functions of the fine-tuned target policies is equal to or less than a predetermined distance.

### Claim 10 (depends on 1)

The method for generating a Pareto policy set of claim 1,
wherein the generating an imitation policy and a reward function of the imitation policy and the fine-tuning of the target policy are performed based on inverse reinforcement learning.

### Claim 11

A device for generating a Pareto policy set comprising:
an input/output interface configured to receive a sample dataset; and
a processor configured to generate a Pareto policy set based on the sample dataset;
wherein the processor is configured to generate an imitation policy and a reward function of the imitation policy from the sample dataset, set a target policy at a predetermined position adjacent to the imitation policy, fine-tune the target policy based on a distance between the reward function of the imitation policy and the reward function of the target policy, and generate a Pareto policy set including the imitation policy and the fine-tuned target policy.

### Claim 12 (depends on 11)

The device for generating a Pareto policy set of claim 11,
wherein the imitation policy includes a first imitation policy and a second imitation policy,
wherein the reward function includes a reward function of the first imitation policy and a reward function of the second imitation policy, and
wherein the processor is further configured to fine-tune the target policy based on a distance between the reward function of the first imitation policy and the reward function of the target policy.

### Claim 13 (depends on 11)

The device for generating a Pareto policy set of claim 11,
wherein the imitation policy includes a first imitation policy and a second imitation policy,
wherein the reward function includes a reward function of the first imitation policy and a reward function of the second imitation policy, and
wherein the processor is further configured to fine-tune the target policy based on a distance between the reward function of the second imitation policy and the reward function of the target policy.

### Claim 14 (depends on 11)

The device for generating a Pareto policy set of claim 11,
wherein the imitation policy includes a first imitation policy and a second imitation policy,
wherein the reward function includes a reward function of the first imitation policy and a reward function of the second imitation policy, and
wherein the processor is further configured to fine-tune the target policy based on a distance between the reward function of the first imitation policy and the reward function of the second imitation policy.

### Claim 15 (depends on 11)

The device for generating a Pareto policy set of claim 11,
wherein the processor is configured to generate a normalization term based on a distance between a reward function of the imitation policy and a reward function of the target policy and a distance between reward functions of the imitation policy, and fine-tune the target policy by learning to maximize a reward function normalization equation including the generated normalization term.

### Claim 16 (depends on 11)

The device for generating a Pareto policy set of claim 11,
wherein the predetermined position is located on a predetermined Pareto front extending between the imitation policies.

### Claim 17 (depends on 11)

The device for generating a Pareto policy set of claim 11,
wherein the processor is configured to update the fine-tuned target policies to the imitation policies when the distance between the reward functions of the fine-tuned target policies exceeds a predetermined distance.

### Claim 18 (depends on 11)

The device for generating a Pareto policy set of claim 11,
wherein the processor is configured to generate the Pareto policy set when a distance between reward functions of the fine-tuned target policies is equal to or less than a predetermined distance.

### Claim 19 (depends on 11)

The device for generating a Pareto policy set of claim 11,
wherein the processor is configured to generate an imitation policy and a reward function of the imitation policy and the fine-tune the target policy by performing inverse reinforcement learning.

### Claim 20

A central server for generating a Pareto policy set, the central server comprising:
an input/output interface configured to receive a sample dataset; and
a processor configured to generate a Pareto policy set based on the sample dataset;
wherein the processor is configured to generate an imitation policy and a reward function of the imitation policy from the sample dataset, set a target policy at a predetermined position adjacent to the imitation policy, fine-tune the target policy based on a distance between the reward function of the imitation policy and the reward function of the target policy, and generate a Pareto policy set including the imitation policy and the fine-tuned target policy.
