# US 2026/0065485 A1 · Method and system for two stage model training to generate a class focused segmentation model

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0065485 A1
- Document ID: US20260065485A1
- Status: Published application
- Kind: A1
- Application number: 19/248,297
- Filed: 2025-06-24
- Published: 2026-03-05
- Earliest claimed: 2024-08-30
- Assignees: Tata Consultancy Services Limited
- Applicants: Tata Consultancy Services Limited
- Inventors: SWARNAVA DEY; SOMA DASGUPTA
- Web page: https://patentgrep.com/patent/US20260065485A1

## CPC

- G06N 3/082: modifying the architecture, e.g. adding, deleting or silencing nodes or connections
- G06T 7/10: Segmentation; Edge detection (motion-based segmentation G06T7/215)
- G06N 3/086: using evolutionary algorithms, e.g. genetic algorithms or genetic programming
- G06N 3/0985: Hyperparameter optimisation; Meta-learning; Learning-to-learn
- G06T 2207/20081: Training; Learning
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

Existing segmentation models have the disadvantage that they cannot be deployed on edge devices as they are not compact and require large space. Embodiments disclosed herein provide a method and system for generating a class focused segmentation model using a two stage model training approach, which enables generation of a compact, task specific model. Using a first stage of training, a Machine Learning (ML) segmentation model that is trained on a master training dataset is generated. Further, in a second stage of training, a fine-tuned task specific segmentation model is generated, which can be used for task specific class segmentation. The fine-tuned task specific segmentation model being task specific and in turn compact, can be used edge device deployment and such applications.

## Claims

### Claim 1

A processor implemented method, comprising:
performing, via one or more hardware processors, a first stage training, comprising, iteratively performing, till a search converges:
receiving a master dataset comprising a plurality of samples on a plurality of classes associated with a test domain, wherein the master dataset is targeted to segment a master set of classes;
dividing the master dataset into a first testing dataset and a first training dataset;
receiving a first search space with a set of hyperparameters associated with the test domain, using the first training dataset;
creating a pre-defined number (N) of candidate models for the received first search space, by performing a AutoML specific search in the received first search space;
training and evaluating each of the N candidate models using the first training dataset for a first pre-defined number of epochs; and
calculating a first fitness score for each of the N candidate models using a multi-objective fitness function represented as
p
=
α
·
mIoU
+
γ
·
1
P
,
where α and γ are linear interpolation coefficients that assign weightage to each objective of a plurality of objectives forming the multi-objective fitness function, and wherein the first fitness score indicates a segmentation accuracy and number of parameters of the N candidate models;
selecting, via the one or more hardware processors, one candidate model from among the N candidate models, based on the first fitness score, wherein the selected candidate model is a multi-class segmentation model forming a master ML segmentation model;
receiving a set of task-specific datasets, via the one or more hardware processors, wherein the task-specific datasets comprise a pre-defined number of samples for training one of a single class segmentation problem and a few-class segmentation problem;
performing, for each of the task-specific datasets, via the one or more hardware processors, a second stage training, comprising, iteratively performing, till a search converges:
receiving the master dataset;
dividing the received master dataset into a second testing dataset and a second training dataset;
receiving a selection on one or more focus classes, wherein each of the one or more focus classes is a subset of the master set of classes;
receiving a second search space with a plurality of the set of hyperparameters used in the master ML segmentation model, wherein the second search space is a subset of the first search space;
creating the pre-defined number (N) of candidate models for the second search space, by performing the AutoML specific search in the received second search space;
training and evaluating each of the N candidate models using the second training dataset for a second pre-defined number of epochs for segmenting the one or more focus classes; and
calculating a second fitness score for each of the N candidate models using a second multi-objective fitness function represented as
p
=
α
·
mIoU
+
(
β
1
·
tIoU
1
+
β
2
·
tIoU
2
+
…
+
β
m
·
tIoU
m
)
+
γ
·
1
P
where, α, β, and γ are the linear interpolation coefficients that assign weightage to each objective of a plurality of objectives forming the second multi-objective fitness function;
selecting, via the one or more hardware processors, one candidate model from among the N candidate models, based on the second fitness score, wherein the selected candidate model is a few class focused compact model, forming a class focused segmentation model; and
fine-tuning, via the one or more hardware processors, the class focused segmentation model to the set of task-specific datasets, to generate a fine-tuned task specific segmentation model.

### Claim 2 (depends on 1)

The processor implemented method of claim 1, wherein the fine-tuned task specific segmentation model is used for class segmentation of a task specific data set from at least one of the first testing dataset and the second testing dataset.

### Claim 3

A system, comprising:
one or more hardware processors;
a communication interface; and
a memory storing a plurality of instructions, wherein the plurality of instructions cause the one or more hardware processors to:
perform a first stage training, comprising, iteratively performing, till a search converges:
receive a master dataset comprising a plurality of samples on a plurality of classes associated with a test domain, wherein the master dataset is targeted to segment a master set of classes;
divide the master dataset into a first testing dataset and a first training dataset;
receive a first search space with a set of hyperparameters associated with the test domain, using the first training dataset;
create a pre-defined number (N) of candidate models for the received first search space, by performing a AutoML specific search in the received first search space;
train and evaluating each of the N candidate models using the first training dataset for a first pre-defined number of epochs; and
calculate a first fitness score for each of the N candidate models using a multi-objective fitness function represented as
p
=
α
·
mIoU
+
γ
·
1
P
,
where, α and γ are linear interpolation coefficients that assign weightage to each objective of a plurality of objectives forming the multi-objective fitness function, wherein the first fitness score indicates a segmentation accuracy and number of parameters of the N candidate models;
selecting, via the one or more hardware processors, one candidate model from among the N candidate models, based on the first fitness score, wherein the selected candidate model is a multi-class segmentation model forming a master ML segmentation model;
receiving a set of task-specific datasets, via the one or more hardware processors, wherein the task-specific datasets comprise a pre-defined number of samples for training one of a single class segmentation problem and a few-class segmentation problem;
performing, for each of the task-specific datasets, via the one or more hardware processors, a second stage training, comprising, iteratively performing, till a search converges:
receiving the master dataset;
dividing the received master dataset into a second testing dataset and a second training dataset;
receiving a selection on one or more focus classes, wherein each of the one or more focus classes is a subset of the master set of classes;
receiving a second search space with a plurality of the set of hyperparameters used in the master ML segmentation model, wherein the second search space is a subset of the first search space;
creating the pre-defined number (N) of candidate models for the second search space, by performing the AutoML specific search in the received second search space;
training and evaluating each of the N candidate models using the second training dataset for a second pre-defined number of epochs for segmenting the one or more focus classes; and
calculating a second fitness score for each of the N candidate models using a second multi-objective fitness function represented as
p
=
α
·
mIoU
+
(
β
1
·
tIoU
1
+
β
2
·
tIoU
2
+
…
+
β
m
·
tIoU
m
)
+
γ
·
1
P
,
where, α, β, and γ are the linear interpolation coefficients that assign weightage to each objective of a plurality of objectives forming the second multi-objective fitness function;
select one candidate model from among the N candidate models, based on the second fitness score, wherein the selected candidate model is a few class focused compact model, forming a class focused segmentation model; and
fine-tune the class focused segmentation model to the set of task-specific datasets, to generate a fine-tuned task specific segmentation model.

### Claim 4 (depends on 3)

The system of claim 3, wherein the fine-tuned task specific segmentation model is used for class segmentation of a task specific data set from at least one of the first testing dataset and the second testing dataset.

### Claim 5

One or more non-transitory machine-readable information storage mediums comprising one or more instructions which when executed by one or more hardware processors cause:
performing a first stage training, comprising, iteratively performing, till a search converges:
receiving a master dataset comprising a plurality of samples on a plurality of classes associated with a test domain, wherein the master dataset is targeted to segment a master set of classes;
dividing the master dataset into a first testing dataset and a first training dataset;
receiving a first search space with a set of hyperparameters associated with the test domain, using the first training dataset;
creating a pre-defined number (N) of candidate models for the received first search space, by performing a AutoML specific search in the received first search space;
training and evaluating each of the N candidate models using the first training dataset for a first pre-defined number of epochs; and
calculating a first fitness score for each of the N candidate models using a multi-objective fitness function represented as
p
=
α
·
mIoU
+
γ
·
1
P
,
where, α and γ are linear interpolation coefficients that assign weightage to each objective of a plurality of objectives forming the multi-objective fitness function, and wherein the first fitness score indicates a segmentation accuracy and number of parameters of the N candidate models;
selecting one candidate model from among the N candidate models, based on the first fitness score, wherein the selected candidate model is a multi-class segmentation model forming a master ML segmentation model;
receiving a set of task-specific datasets wherein the task-specific datasets comprise a pre-defined number of samples for training one of a single class segmentation problem and a few-class segmentation problem;
performing, for each of the task-specific datasets a second stage training, comprising, iteratively performing, till a search converges:
receiving the master dataset;
dividing the received master dataset into a second testing dataset and a second training dataset;
receiving a selection on one or more focus classes, wherein each of the one or more focus classes is a subset of the master set of classes;
receiving a second search space with a plurality of the set of hyperparameters used in the master ML segmentation model, wherein the second search space is a subset of the first search space;
creating the pre-defined number (N) of candidate models for the second search space, by performing the AutoML specific search in the received second search space;
training and evaluating each of the N candidate models using the second training dataset for a second pre-defined number of epochs for segmenting the one or more focus classes; and
calculating a second fitness score for each of the N candidate models using a second multi-objective fitness function represented as
p
=
α
·
mIoU
+
(
β
1
·
tIoU
1
+
β
2
·
tIoU
2
+
…
+
β
m
·
tIoU
m
)
+
γ
·
1
P
,
where, α, β, and γ are the linear interpolation coefficients that assign weightage to each objective of a plurality of objectives forming the second multi-objective fitness function;
selecting one candidate model from among the N candidate models, based on the second fitness score, wherein the selected candidate model is a few class focused compact model, forming a class focused segmentation model; and
fine-tuning the class focused segmentation model to the set of task-specific datasets, to generate a fine-tuned task specific segmentation model.

### Claim 6 (depends on 5)

The one or more non-transitory machine readable information storage mediums of claim 5, wherein the fine-tuned task specific segmentation model is used for class segmentation of a task specific data set from at least one of the first testing dataset and the second testing dataset.
