# US 2024/0267624 A1 · Full frame media stabilization in electronic devices

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0267624 A1
- Document ID: US20240267624A1
- Status: Published application
- Kind: A1
- Application number: 18/434,056
- Filed: 2024-02-06
- Published: 2024-08-08
- Earliest claimed: 2023-02-07
- Assignees: Samsung Electronics Co., Ltd.
- Applicants: Samsung Electronics Co., Ltd.
- Inventors: Raj Narayana GADDE; Sarvesh; Yathish Reddy; Addanki Sankara Rao; Pravin Ramachandran Nair
- Web page: https://patentgrep.com/patent/US20240267624A1

## CPC

- H04N 23/683: {performed by a processor, e.g. controlling the readout of an image memory}
- H04N 5/2628: {Alteration of picture size, shape, position or orientation, e.g. zooming, rotation, rolling, perspective, translation}
- H04N 23/65: Control of camera operation in relation to power supply
- H04N 23/68: for stable pick-up of the scene, e.g. compensating for camera body vibrations
- H04N 23/6811: {based on the image signal}
- H04N 23/6812: {based on additional sensors, e.g. acceleration sensors}
- H04N 23/81: for suppressing or minimising disturbance in the image signal generation
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A method may comprise detecting at least one motion of the electronic device while capturing a plurality of media frames, determining a type of the at least one motion of the electronic device while capturing the plurality of media frames, determining a variation in the type of the at least one motion of the electronic device over a pre-determined period of time, selecting at least one stabilization procedure from a plurality of stabilization procedures and a frame fusion procedure from a plurality of frame fusion procedures based on the type of the at least one motion of the electronic device and the variation in the type of the at least one motion of the electronic device, and stabilizing, after the capturing of the plurality of media frames, the plurality of media frames based on the at least one selected stabilization procedure and the selected frame fusion procedure.

## Claims

### Claim 1

A method for full frame media stabilization, the method performed by an electronic device, the method comprising:
detecting at least one motion of the electronic device while capturing a plurality of media frames;
determining a type of the at least one motion of the electronic device while capturing the plurality of media frames;
determining a variation in the type of the at least one motion of the electronic device over a pre-determined period of time;
selecting at least one stabilization procedure from a plurality of stabilization procedures and a frame fusion procedure from a plurality of frame fusion procedures based on the type of the at least one motion of the electronic device and the variation in the type of the at least one motion of the electronic device; and
stabilizing, after the capturing of the plurality of media frames, the plurality of media frames based on the at least one selected stabilization procedure from the plurality of stabilization procedures and the selected frame fusion procedure from the plurality of frame fusion procedures.

### Claim 2 (depends on 1)

The method of claim 1, wherein the selecting the at least one stabilization procedure and the frame fusion procedure based on the type of the at least one motion and the variation in the type of the at least one motion comprises:
determining a complexity level of the at least one motion based on at least one stabilization parameter, the type of the at least one motion, and the variation in the type of the at least one motion; and
selecting the at least one stabilization procedure based on the complexity level of the at least one motion.

### Claim 3 (depends on 1)

The method of claim 1, wherein the stabilizing the plurality of media frames based on the at least one selected stabilization procedure and the selected frame fusion procedure, comprises:
stabilizing at least one media frame of the plurality of media frames based on the at least one selected stabilization procedure; and
determining the full frame media stabilization using the selected frame fusion procedure for the at least one stabilized media frame.

### Claim 4 (depends on 2)

The method of claim 2, wherein the at least one stabilization parameter comprises at least one of a power consumed for stabilization of the plurality of media frames by each of the plurality of stabilization procedures, a time taken for stabilization of the plurality of media frames by each of the plurality of stabilization procedures, and a correlation between each of the plurality of media frames and each of the plurality of stabilization procedures.

### Claim 5 (depends on 1)

The method of claim 1, wherein the type of the at least one motion is determined based on an analysis of one or more objects included in the plurality of media frames and a motion sensor.

### Claim 6 (depends on 2)

The method of claim 2, wherein the stabilizing the plurality of media frames based on the at least one selected stabilization procedure and the selected frame fusion procedure comprises:
determining one or more crop parameters for the stabilizing the plurality of media frames based on the complexity level of the at least one motion of the electronic device; and
cropping a pre-determined size of at least one media frame of the plurality of media frames based on the determined one or more crop parameters.

### Claim 7 (depends on 2)

The method of claim 2, wherein the frame fusion procedure comprises:
receiving the type of the at least one motion of the electronic device;
selecting at least one fusion procedure from the plurality of fusion procedure based on the type of the at least one motion, wherein selecting the fusion procedure comprises selecting the plurality of media frames;
receiving stabilized frame from a path smoothing component;
restoring the at least one media frame of the plurality of media frames based on the at least one fusion procedure selected using the plurality of media frames; and
fusing the plurality of media frames based on the type of the at least one motion and variation dynamically.

### Claim 8 (depends on 1)

The method of claim 1, wherein the determining the type of the at least one motion comprises:
receiving, from a motion sensor, a plurality of motions of the electronic device;
determining the type of the at least one motion using at least one motion estimation method and the received plurality of motions of the electronic device; and
classifying the type of the at least one motion based on an output of the at least one motion estimation method.

### Claim 9

An electronic device for full frame media stabilization, the electronic device comprising:
a memory;
at least one processor;
a motion sensor configured to detect at least one motion of the electronic device while capturing a plurality of media frames; and
at least one image sensor configured to capture the plurality of media frames,
wherein the at least one processor is configured to;
determine a type of the at least one motion of the electronic device while capturing the plurality of media frames;
determine a variation in the type of the at least one motion of the electronic device over a pre-determined period of time;
select at least one stabilization procedure from a plurality of stabilization procedures and a frame fusion procedure from a plurality of frame fusion procedures based on the type of the at least one motion of the electronic device and the variation in the type of the at least one motion of the electronic device; and
stabilize, after the capture of the plurality of media frames, the plurality of media frames based on the at least one selected stabilization procedure from the plurality of stabilization procedures and the selected frame fusion procedure from the plurality of frame fusion procedures.

### Claim 10 (depends on 9)

The electronic device of claim 9, wherein, to select the at least one stabilization procedure and the frame fusion procedure based on the type of the at least one motion and the variation in the type of the at least one motion, the at least one processor is configured to:
determine a complexity level of the at least one motion based on at least one stabilization parameter, the type of the at least one motion, and the variation in the type of the at least one motion; and
select the at least one stabilization procedure based on the complexity level of the at least one motion.

### Claim 11 (depends on 9)

The electronic device of claim 9, wherein, to stabilize the plurality of media frames based on the at least one selected stabilization procedure and the selected frame fusion procedure, the at least one processor is configured to:
stabilize at least one media frame of the plurality of media frames based on the at least one selected stabilization procedure; and
determine the full frame media stabilization using the selected frame fusion procedure for the at least one stabilized media frame.

### Claim 12 (depends on 10)

The electronic device of claim 10, wherein the at least one stabilization parameter comprises at least one of a power consumed for stabilization of the plurality of media frames by each of the plurality of stabilization procedures, a time taken for stabilization of the plurality of media frames by each of the plurality of stabilization procedures, and a correlation between each of the plurality of media frames and each of the plurality of stabilization procedures.

### Claim 13 (depends on 9)

The electronic device of claim 9, wherein the type of the at least one motion is determined based on an analysis of one or more objects included in the plurality of media frames and a motion sensor.

### Claim 14 (depends on 10)

The electronic device of claim 10, wherein, to stabilize the plurality of media frames based on the at least one selected stabilization procedure and the selected frame fusion procedure, the at least one processor is configured to:
determine one or more crop parameters for the stabilizing the plurality of media frames based on the complexity level of the at least one motion of the electronic device; and
crop a pre-determined size of at least one media frame of the plurality of media frames based on the determined one or more crop parameters.

### Claim 15 (depends on 10)

The electronic device of claim 10, wherein the frame fusion procedure comprises:
receiving the type of the least one motion of the at least one motion of the electronic device;
selecting at least one fusion procedure from the plurality of fusion procedure based on the type of the at least one motion, wherein selecting the fusion procedure comprises selecting the plurality of media frames;
receiving stabilized frame from a path smoothing component;
restoring the at least one media frame of the plurality of media frames based on the at least one fusion procedure selected using the plurality of media frames; and
fusing the plurality of media frames based on the type of the at least one motion and variation dynamically.

### Claim 16 (depends on 9)

The electronic device of claim 9, wherein, to determine the type of the at least one motion, the at least one processor is configured to:
receive a plurality of motions of the electronic device;
determine the type of the at least one motion using at least one motion estimation method and the received plurality of motions of the electronic device; and
classify the type of the at least one motion based on an output of the at least one motion estimation method.

### Claim 17

A computer-readable storage media storing a program that, when executed by at least one processor of an electronic device, causes the electronic device to perform a method comprising:
detecting at least one motion of the electronic device while capturing a plurality of media frames;
determining a type of the at least one motion of the electronic device while capturing the plurality of media frames;
determining a variation in the type of the at least one motion of the electronic device over a pre-determined period of time;
selecting at least one stabilization procedure from a plurality of stabilization procedures and a frame fusion procedure from a plurality of frame fusion procedures based on the type of the at least one motion of the electronic device and the variation in the type of the at least one motion of the electronic device; and
stabilizing, after the capturing of the plurality of media frames, the plurality of media frames based on the at least one selected stabilization procedure from the plurality of stabilization procedures and the selected frame fusion procedure from the plurality of frame fusion procedures.

### Claim 18 (depends on 17)

The computer-readable storage media of claim 17, wherein the selecting the at least one stabilization procedure and the frame fusion procedure based on the type of the at least one motion and the variation in the type of the at least one motion comprises:
determining a complexity level of the at least one motion based on at least one stabilization parameter, the type of the at least one motion, and the variation in the type of the at least one motion; and
selecting the at least one stabilization procedure based on the complexity level of the at least one motion.

### Claim 19 (depends on 17)

The computer-readable storage media of claim 17, wherein the stabilizing the plurality of media frames based on the at least one selected stabilization procedure and the selected frame fusion procedure, comprises:
stabilizing at least one media frame of the plurality of media frames based on the at least one selected stabilization procedure; and
determining the full frame media stabilization using the selected frame fusion procedure for the at least one stabilized media frame.

### Claim 20 (depends on 18)

The computer-readable storage media of claim 18, wherein the at least one stabilization parameter comprises at least one of a power consumed for stabilization of the plurality of media frames by each of the plurality of stabilization procedures, a time taken for stabilization of the plurality of media frames by each of the plurality of stabilization procedures, and a correlation between each of the plurality of media frames and each of the plurality of stabilization procedures.
