Reinforcement learning model for labeling spatial relationships between images
AssigneeOMRON Corporation
InventorTatsunori Taniai
Life of this patent
Estimating the term…
Abstract
A computing system is provided, including a processor configured to receive a labeling map for a first image. The labeling map may indicate a spatial relationship between a first region of interest included in the first image and a second region of interest included in a second image. At a trained reinforcement learning model, the processor may be further configured to generate an updated labeling map for the first image based on at least the labeling map, the first image, and the second image.
Claims20
A computing system comprising:
- a processor configured to:
- receive a labeling map for a first image, wherein the labeling map indicates a spatial relationship between a first region of interest included in the first image and a second region of interest included in a second image;
- and
- at a trained reinforcement learning model, generate an updated labeling map for the first image based on at least the labeling map, the first image, and the second image.
A method for use with a computing system, the method comprising:
- receiving a labeling map for a first image, wherein the labeling map indicates a spatial relationship between a first region of interest included in the first image and a second region of interest included in a second image;
- and
- at a trained reinforcement learning model, generating an updated labeling map for the first image based on at least the labeling map, the first image, and the second image.
A computing system comprising:
- one or more processors configured to:
- generate a trained reinforcement learning model using a plurality of training images, at least in part by, for each of the training images:
- at an agent module, determining a candidate labeling update action for a candidate labeling map associated with the training image at least in part by applying a policy function with one or more agent parameters to the candidate labeling map, the training image, and an additional training image of the plurality of training images;
- at an evaluation module, determining an evaluation metric value for the candidate labeling map;
- at an environment module, determining:
- an updated candidate labeling map based on at least the candidate labeling map and the candidate labeling update action;
- and
- a reward value based on the candidate labeling update action and the evaluation metric value;
- and
- at an updater module, modifying the one or more agent parameters of the agent module based at least in part on the candidate labeling map, the candidate labeling update action, the updated candidate labeling map, and the reward value;
- and
- at runtime:
- receive a labeling map for a first image, wherein:
- the labeling map indicates a spatial relationship between a first region of interest included in the first image and a second region of interest included in a second image;
- and
- the labeling map is an optical flow map, a disparity map, or a depth map;
- and
- at a trained reinforcement learning model, generate an updated labeling map for the first image based on at least the labeling map, the first image, and the second image.
Dependencies are inferred from the claim text.