# US 2025/0157009 A1 · Electronic apparatus and control method thereof

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0157009 A1
- Document ID: US20250157009A1
- Status: Published application
- Kind: A1
- Application number: 18/824,405
- Filed: 2024-09-04
- Published: 2025-05-15
- Earliest claimed: 2023-11-15
- Assignees: Samsung Electronics Co., Ltd.
- Applicants: Samsung Electronics Co., Ltd.
- Inventors: Shinhaeng KIM; Woonsung PARK; Wonseok SONG
- Web page: https://patentgrep.com/patent/US20250157009A1

## CPC

- G06T 5/70: Denoising; Smoothing
- G06T 5/60: using machine learning, e.g. neural networks
- G06T 7/246: using feature-based methods, e.g. the tracking of corners or segments
- H04N 5/14: Picture signal circuitry for video frequency region (cameras or camera modules comprising electronic image sensors, or control thereof H04N23/00)
- H04N 7/01: Conversion of standards {, e.g. involving analogue television standards or digital television standards processed at pixel level}
- G06T 2207/20081: Training; Learning
- G06T 2207/20084: Artificial neural networks [ANN]
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

An electronic apparatus including memory storing one or more instructions and at least one processor that is connected with the memory and controls the electronic apparatus, wherein the at least one processor is configured to, by executing the one or more instructions, identify an area where a motion is maintained in an input image, identify motion information of the identified area and representative motion information of the identified area, identify a motion correction value based on the identified motion information and the identified representative motion information, perform motion compensation for an input frame included in the input image by applying the identified motion correction value to the identified area, obtain an interpolation frame by applying the identified motion correction value to the identified area, and obtain an output image based on the input frame for which the motion compensation was performed and the obtained interpolation frame.

## Claims

### Claim 1

An electronic apparatus comprising:
memory storing one or more instructions; and
at least one processor is configured to, by executing the one or more instructions:
identify an area where a motion is maintained in an input image,
identify motion information of the identified area and representative motion information of the identified area,
identify a motion correction value based on the identified motion information and the identified representative motion information,
perform motion compensation for an input frame included in the input image by applying the identified motion correction value to the identified area,
obtain an interpolation frame by applying the identified motion correction value to the identified area, and
obtain an output image based on the input frame for which the motion compensation was performed and the obtained interpolation frame.

### Claim 2 (depends on 1)

The electronic apparatus of claim 1,
wherein the at least one processor is configured to, by executing the one or more instructions:
obtain the interpolation frame by using the identified motion correction value for the identified area, and not using the identified motion correction value for an area other than the identified area.

### Claim 3 (depends on 2)

The electronic apparatus of claim 2,
wherein the at least one processor is configured to, by executing the one or more instructions:
perform motion compensation for the input frame by using the identified motion correction value for the identified area, and not using the identified motion correction value for the area other than the identified area.

### Claim 4 (depends on 1)

The electronic apparatus of claim 1,
wherein the at least one processor is configured to, by executing the one or more instructions:
obtain a plurality of motion vectors corresponding to the identified area in a plurality of input frames included in the input image, and identify a representative motion vector that is consistently maintained in the identified area based on the obtained plurality of motion vectors.

### Claim 5 (depends on 4)

The electronic apparatus of claim 4,
wherein the at least one processor is configured to, by executing the one or more instructions:
identify motion correction values corresponding to each of the plurality of input frames based on difference values between each of the plurality of motion vectors corresponding to the identified area and the representative motion vector.

### Claim 6 (depends on 5)

The electronic apparatus of claim 5,
wherein the at least one processor is configured to, by executing the one or more instructions:
identify motion correction values corresponding to each of the plurality of input frames by applying a predetermined filter to the difference values between each of the plurality of motion vectors corresponding to the identified area and the representative motion vector.

### Claim 7 (depends on 1)

The electronic apparatus of claim 1,
wherein the at least one processor is configured to, by executing the one or more instructions:
identify the area where the motion is maintained based on motion vector statistical values for each of a plurality of pixel areas included in the input image, or
identify the area where the motion is maintained by inputting the input image into a trained artificial intelligence model.

### Claim 8 (depends on 1)

The electronic apparatus of claim 1,
wherein the at least one processor is configured to, by executing the one or more instructions:
identify a moving distance where a sum of differences of luminance values of pixels included in the identified area is minimum in a plurality of input frames included in the input image as a motion vector of the identified area.

### Claim 9 (depends on 1)

The electronic apparatus of claim 1,
wherein the at least one processor is configured to, by executing the one or more instructions:
identify pixels included in the identified area as a plurality of pixel areas, and identify motion vectors of the identified area based on statistical values of motion vectors identified in units of the plurality of pixel areas.

### Claim 10 (depends on 1)

The electronic apparatus of claim 1,
wherein the area where the motion is maintained comprises:
an area where a text consistently moves in a specific location of the input image.

### Claim 11

A control method of an electronic apparatus, the control method comprising:
identifying an area where a motion is maintained in an input image;
identifying motion information of the identified area and representative motion information of the identified area;
identifying a motion correction value based on the identified motion information and the identified representative motion information;
obtaining an output image by applying the identified motion correction value to the identified area;
performing motion compensation for an input frame included in the input image by applying the identified motion correction value to the identified area;
obtaining an interpolation frame by applying the identified motion correction value to the identified area; and
obtaining an output image based on the input frame for which the motion compensation was performed and the obtained interpolation frame.

### Claim 12 (depends on 11)

The control method of claim 11,
wherein the obtaining the output image comprises:
obtaining the interpolation frame by using the identified motion correction value for the identified area, and not using the identified motion correction value for an area other than the identified area.

### Claim 13 (depends on 12)

The control method of claim 12,
wherein the obtaining the output image comprises:
performing motion compensation for the input frame by using the identified motion correction value for the identified area, and not using the identified motion correction value for the area other than the identified area.

### Claim 14 (depends on 11)

The control method of claim 11,
wherein the identifying the motion information of the identified area and the representative motion information of the identified area comprises:
obtaining a plurality of motion vectors corresponding to the identified area in a plurality of input frames included in the input image, and identifying a representative motion vector that is consistently maintained in the identified area based on the obtained plurality of motion vectors.

### Claim 15

A non-transitory computer readable medium storing computer instructions that make an electronic apparatus perform operations in case the instructions are executed by a processor of the electronic apparatus, wherein the operations comprise:
identifying an area where a motion is maintained in an input image;
identifying motion information of the identified area and representative motion information of the identified area;
identifying a motion correction value based on the identified motion information and the identified representative motion information;
obtaining an output image by applying the identified motion correction value to the identified area;
performing motion compensation for an input frame included in the input image by applying the identified motion correction value to the identified area;
obtaining an interpolation frame by applying the identified motion correction value to the identified area; and
obtaining an output image based on the input frame for which the motion compensation was performed and the obtained interpolation frame.

### Claim 16 (depends on 15)

The non-transitory computer-readable medium as claimed in claim 15, wherein
wherein the obtaining the output image comprises:
obtaining the interpolation frame by using the identified motion correction value for the identified area, and not using the identified motion correction value for an area other than the identified area.

### Claim 17 (depends on 16)

The non-transitory computer-readable medium as claimed in claim 16,
wherein the obtaining the output image comprises:
performing motion compensation for the input frame by using the identified motion correction value for the identified area, and not using the identified motion correction value for the area other than the identified area.

### Claim 18 (depends on 15)

The non-transitory computer-readable medium as claimed in claim 15,
wherein the identifying the motion information of the identified area and the representative motion information of the identified area comprises:
obtaining a plurality of motion vectors corresponding to the identified area in a plurality of input frames included in the input image, and identifying a representative motion vector that is consistently maintained in the identified area based on the obtained plurality of motion vectors.

### Claim 19 (depends on 15)

The non-transitory computer-readable medium as claimed in claim 15,
wherein the identifying a motion correction value comprises:
identifying the motion correction values corresponding to each of the plurality of input frames based on difference values between each of the plurality of motion vectors corresponding to the identified area and the representative motion vector.

### Claim 20 (depends on 15)

The non-transitory computer-readable medium as claimed in claim 15,
wherein the identifying a motion correction value comprises:
identifying the motion correction values corresponding to each of the plurality of input frames by applying a predetermined filter to the difference values between each of the plurality of motion vectors corresponding to the identified area and the representative motion vector.
