# US 2025/0185126 A1 · Estimating Motion of a Load Carrier

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0185126 A1
- Document ID: US20250185126A1
- Status: Published application
- Kind: A1
- Application number: 18/526,399
- Filed: 2023-12-01
- Published: 2025-06-05
- Earliest claimed: 2023-12-01
- Assignees: Samsung Electronics Co., Ltd.
- Applicants: Samsung Electronics Co., Ltd.
- Inventors: Musa Maharramov; Brian Patton; Pedro Martinez Lopez
- Web page: https://patentgrep.com/patent/US20250185126A1

## CPC

- H05B 6/6455: {the sensors being infrared detectors}
- G06T 7/215: Motion-based segmentation
- G06T 7/262: using transform domain methods, e.g. Fourier domain methods
- H05B 6/6411: {the supports being rotated}
- H05B 6/782: {wherein the material moved is food}
- G06T 2207/10016: Video; Image sequence
- G06T 2207/10024: Color image
- G06T 2207/10048: Infrared image
- G06T 2207/30128: Food products
- H05B: ELECTRIC HEATING; ELECTRIC LIGHT SOURCES NOT OTHERWISE PROVIDED FOR; CIRCUIT ARRANGEMENTS FOR ELECTRIC LIGHT SOURCES, IN GENERAL
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

In one embodiment, a method includes accessing an initial image of a load on a moving load carrier, the initial image of the load having been captured at an initial time, and accessing a subsequent image of the load at a subsequent time. The method further includes generating a transformed set of images including a first initial image and a first subsequent image, by transforming at least one of: (1) the initial image to the first initial image or (2) the subsequent image to the first subsequent image according to a motion profile of the load carrier from the initial time to the subsequent time. The method further includes estimating a motion of the load carrier from the initial time to the subsequent time based on minimizing a difference between the first subsequent image of the load and the first initial image of the load.

## Claims

### Claim 1

A method comprising:
accessing an initial image of a load on a moving load carrier, the initial image of the load having been captured at an initial time;
accessing a subsequent image of the load on the moving load carrier, the subsequent image having been captured at a subsequent time;
generating a transformed set of images comprising a first initial image and a first subsequent image, wherein creating the transformed set of images comprises transforming at least one of: (1) the initial image to the first initial image or (2) the subsequent image to the first subsequent image according to a motion profile of the load carrier from the initial time to the subsequent time; and
estimating a motion of the load carrier from the initial time to the subsequent time based on minimizing a difference between the first subsequent image of the load and the first initial image of the load.

### Claim 2 (depends on 1)

The method of claim 1, wherein estimating the motion of a load carrier comprises estimating one or more of (1) a rotation of the load carrier or (2) a motion of at least a portion of the load carrier along one or more predetermined trajectories.

### Claim 3 (depends on 1)

The method of claim 1, wherein estimating the rotation of a load carrier comprises estimating one or more of (1) a periodic motion of at least a portion of the load carrier or (2) a translation of at least a portion of the load carrier.

### Claim 4 (depends on 1)

The method of claim 1, further comprising estimating the motion of the load carrier by minimizing an objective function that is based on (1) the difference between the first subsequent image of the load and the first initial image of the load and (2) a likelihood distribution of the motion of the load carrier at the subsequent time.

### Claim 5 (depends on 4)

The method of claim 4, further comprising estimating the motion of the load carrier by minimizing an objective function that includes an image noise model.

### Claim 6 (depends on 4)

The method of claim 4, wherein the likelihood distribution of the motion of the load carrier at the subsequent time is based on an estimated rate of motion of the load carrier.

### Claim 7 (depends on 6)

The method of claim 6, wherein the estimated motion rate of the load carrier is based on a plurality of images of the load on the moving load carrier, each of the plurality of images have been captured at a corresponding time between the initial time and the subsequent time.

### Claim 8 (depends on 7)

The method of claim 7, wherein the estimated motion rate of the load carrier and the likelihood distribution of the motion of the load carrier at the subsequent time are each based on an estimated variance of an acceleration of the load carrier.

### Claim 9 (depends on 4)

The method of claim 4, wherein the likelihood distribution of the motion of the load carrier at the subsequent time is based on modeling rotational dynamics of the load carrier as a stochastic process.

### Claim 10 (depends on 9)

The method of claim 9, further comprising determining, based on the modeled stochastic process, a temporal deviation of the rotation rate, the deviation comprising a seasonal signal, a trend signal, and a residual signal.

### Claim 11 (depends on 4)

The method of claim 4, wherein them motion of the load carrier comprises a rotation of the load carrier, and the likelihood distribution comprises an initial likelihood distribution, the method further comprising:
accessing a plurality of additional images, each captured at a time after the subsequent time;
determining whether the initial image, the subsequent image, and the plurality of additional images comprise sufficient data to define a state evolution of the load carrier; and
in response to a determination that there is sufficient data to define a state evolution of the load carrier, then:
determining, based on the defined state evolution, an updated likelihood distribution of the rotation of the load carrier;
accessing a plurality of images of the load carrier captured during a period of time; and
determining, based on the updated likelihood distribution and the plurality of images of the load carrier, a rotation of the load carrier during the period of time.

### Claim 12 (depends on 1)

The method of claim 1, wherein the initial image and the subsequent image are captured by an imaging apparatus comprising one or more of:
one or more RBG cameras; or
one or more thermal cameras

### Claim 13 (depends on 1)

The method of claim 1, further comprising:
accessing an initial segmentation mask of the load; and
determining, based on the initial segmentation mask and the estimated motion of the load carrier, an updated segmentation mask for the load.

### Claim 14 (depends on 13)

The method of claim 13, wherein the load comprises a food item in a microwave and the motion of the load carrier comprises a rotation of the load carrier.

### Claim 15 (depends on 13)

The method of claim 13, further comprising calculating, based upon the updated segmentation mask for the load, one or more statistics of the load.

### Claim 16 (depends on 15)

The method of claim 15, wherein the one or more statistics of the load comprise one or more of: a temperature distribution within the load, a mean temperature of the load, a median temperature of the load, or a statistic of the load that is based on a determined temperature of the load.

### Claim 17 (depends on 1)

The method of claim 1, wherein the load comprises a food item in a microwave.

### Claim 18

A system comprising:
one or more non-transitory computer readable storage media storing instructions; and one or more processors coupled to the non-transitory computer readable storage media, the one or more processors operable to execute the instructions to:
access an initial image of a load on a moving load carrier, the initial image of the load having been captured at an initial time;
access a subsequent image of the load on the moving load carrier, the subsequent image having been captured at a subsequent time;
generate a transformed image set comprising a first initial image and a first subsequent image, wherein creating the transformed image set comprises transforming at least one of: (1) the initial image to the first initial image or (2) the subsequent image to the first subsequent image according to a motion profile of the load carrier from the initial time to the subsequent time; and
estimate a motion of the load carrier from the initial time to the subsequent time based on minimizing a difference between the subsequent image of the load and the initial image of the load.

### Claim 19 (depends on 18)

The system of claim 18, wherein the one or more processors are further operable to estimate the motion of the load carrier by minimizing an objective function that is based on (1) the difference between the first subsequent image of the load and the first initial image of the load and (2) a likelihood distribution of the motion of the load carrier at the subsequent time.

### Claim 20 (depends on 19)

The system of claim 19, wherein the likelihood distribution of the motion of the load carrier at the subsequent time is based on modeling rotational dynamics of the load carrier as a stochastic process.

### Claim 21 (depends on 19)

The system of claim 19, wherein the motion of the load carrier comprises a rotation of the load carrier, and the likelihood distribution comprises an initial likelihood distribution, further comprising one or more processors operable to execute the instructions to:
access a plurality of additional images, each captured at a time after the subsequent time;
determine whether the initial image, the subsequent image, and the plurality of additional images comprise sufficient data to define a state evolution of the load carrier; and
in response to a determination that there is sufficient data to define a state evolution of the load carrier, then:
determine, based on the defined state evolution, an updated likelihood distribution of the rotation of the load carrier;
access a plurality of images of the load carrier captured during a period of time; and
determine, based on the updated likelihood distribution and the plurality of images of the load carrier, a rotation of the load carrier during the period of time.

### Claim 22

One or more non-transitory computer readable storage media storing instructions and coupled to one or more processors that are operable to execute the instructions to:
access an initial image of a load on a moving load carrier, the initial image of the load having been captured at an initial time;
access a subsequent image of the load on the moving load carrier, the subsequent image having been captured at a subsequent time;
generate a transformed image set comprising a first initial image and a first subsequent image, wherein creating the transformed image set comprises transforming at least one of: (1) the initial image to the first initial image or (2) the subsequent image to the first subsequent image according to a motion profile of the load carrier from the initial time to the subsequent time; and
estimate a motion of the load carrier from the initial time to the subsequent time based on minimizing a difference between the subsequent image of the load and the initial image of the load.

### Claim 23 (depends on 22)

The media of claim 22, wherein the one or more processors are further operable to execute the instructions to estimate the motion of the load carrier by minimizing an objective function that is based on (1) the difference between the first subsequent image of the load and the first initial image of the load and (2) a likelihood distribution of the motion of the load carrier at the subsequent time.

### Claim 24 (depends on 23)

The media of claim 23, wherein the likelihood distribution of the motion of the load carrier at the subsequent time is based on modeling rotational dynamics of the load carrier as a stochastic process.

### Claim 25 (depends on 23)

The media of claim 23, wherein the motion of the load carrier comprises a rotation of the load carrier, and the likelihood distribution comprises an initial likelihood distribution, the one or more non-transitory computer readable storage media storing further instructions and coupled to one or more processors that are operable to execute the instructions to:
access a plurality of additional images, each captured at a time after the subsequent time;
determine whether the initial image, the subsequent image, and the plurality of additional images comprise sufficient data to define a state evolution of the load carrier; and
in response to a determination that there is sufficient data to define a state evolution of the load carrier, then:
determine, based on the defined state evolution, an updated likelihood distribution of the rotation of the load carrier;
access a plurality of images of the load carrier captured during a period of time; and
determine, based on the updated likelihood distribution and the plurality of images of the load carrier, a rotation of the load carrier during the period of time.
