# US 2026/0094620 A1 · Systems and methods for asset editing

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0094620 A1
- Document ID: US20260094620A1
- Status: Published application
- Kind: A1
- Application number: 19/340,098
- Filed: 2025-09-25
- Published: 2026-04-02
- Earliest claimed: 2024-09-27
- Assignees: Samsung Electronics Co., Ltd.
- Applicants: Samsung Electronics Co., Ltd.
- Inventors: Ping HU; Taekhyun KIM; Yanlin ZHOU; Mostafa EL-KHAMY
- Web page: https://patentgrep.com/patent/US20260094620A1

## CPC

- G11B 27/036: Insert-editing
- G06T 5/60: using machine learning, e.g. neural networks
- G06T 5/70: Denoising; Smoothing
- G06T 7/50: Depth or shape recovery
- G06T 7/55: from multiple images
- G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80)
- G06T 7/73: using feature-based methods
- G11B 27/031: Electronic editing of digitised analogue information signals, e.g. audio or video signals
- G06T 2207/10016: Video; Image sequence
- G06T 2207/10024: Color image
- G06T 2207/20081: Training; Learning
- G06T 2207/20084: Artificial neural networks [ANN]
- G06T 2207/20092: Interactive image processing based on input by user
- G06T 2207/20104: Interactive definition of region of interest [ROI]
- G06T 2207/30168: Image quality inspection
- G06T 2207/30244: Camera pose
- G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

Systems and methods are disclosed for video generation. A video subclip is extracted from a video. The video subclip includes a sequence of continuous video frames based on content determined in the video frames. A camera pose is determined in a first video frame of the video subclip. A camera pose is estimated for each video frame in the video subclip relative to the camera pose of the first video frame. An environment lighting condition is estimated for the video subclip based on the estimated camera pose of each video frame. A new video subclip is generated by placing the environment lighting condition in image latent space of the video subclip.

## Claims

### Claim 1

A method comprising:
extracting a video subclip from a video, the video subclip including a sequence of continuous video frames based on content determined in the video frames;
determining a camera pose in a first video frame of the video subclip;
estimating a camera pose for each video frame in the video subclip relative to the camera pose of the first video frame;
estimating an environment lighting condition for the video subclip based on the estimated camera pose of each video frame; and
generating a new video subclip by placing the environment lighting condition in image latent space of the video subclip.

### Claim 2 (depends on 1)

The method of claim 1, wherein the video may comprise any length.

### Claim 3 (depends on 1)

The method of claim 1, wherein the video subclip comprises a length in a range of 1 to 32 video frames.

### Claim 4 (depends on 1)

The method of claim 1, further comprising training a transformer-based feedforward neural network to align a plurality of environment images, each of the environment images extracted from a video frame in the video subclip, the plurality of environment images aligned based on the estimated camera pose for each video frame.

### Claim 5 (depends on 1)

The method of claim 1, wherein placing the environment lighting condition in image latent space of the video subclip comprises use of an encoder.

### Claim 6 (depends on 5)

The method of claim 5, wherein the encoder comprises a variational autoencoder (VAE).

### Claim 7

A method comprising:
receiving, from a user, a selected area of a video frame of a video;
receiving, from the user, one or more material attributes in the selected area and one or more quantitative material adjustments for the material attributes;
extracting a video subclip from the video, the video subclip including the video frame and a sequence of continuous video frames based on content determined in the video frames;
determining a camera pose in a first video frame of the video subclip;
estimating a camera pose for each video frame in the video subclip relative to the camera pose of the first video frame;
estimating an environment lighting condition for the video subclip based on the estimated camera pose of each video frame;
estimating a surface normal of the selected area on each video frame of the video subclip;
estimating a depth of the selected area on each video frame of the video subclip; and
modifying one or more pixel colors in the selected area based on the following:
the estimated surface normal of the selected area;
the estimated depth of the selected area;
the environment lighting condition;
the material attributes; and
the quantitative material adjustments.

### Claim 8 (depends on 7)

The method of claim 7, wherein the video may comprise any length.

### Claim 9 (depends on 7)

The method of claim 7, further comprising aligning a plurality of environment images, each of the environment images extracted from a video frame in the video subclip, the plurality of environment images aligned based on the estimated camera pose for the video frame.

### Claim 10 (depends on 9)

The method of claim 9, further comprising training a transformer-based feedforward neural network to align the plurality of environment images.

### Claim 11 (depends on 7)

The method of claim 7, further comprising encoding the environment lighting condition in image latent space of the video subclip utilizing an encoder.

### Claim 12 (depends on 11)

The method of claim 11, wherein the encoder comprises a variational autoencoder (VAE).

### Claim 13 (depends on 7)

The method of claim 7, wherein the material attributes comprise at least one of the following: roughness, metallic, transparency, or albedo.

### Claim 14 (depends on 7)

The method of claim 7, further comprising identifying key frames in the video, the video subclip based on the keyframes.

### Claim 15 (depends on 7)

The method of claim 7, further comprising:
determining initial noise, convolution features, and attention features of each video frame in the video subclip;
editing the first video frame of the video subclip to generate an edited frame based on the selected area, material attributes, and the quantitative material adjustments; and
generating a new video subclip based on:
the edited frame
the initial noise of each video frame in the video subclip; and
the selected area, the material attributes, and the quantitative material adjustments.

### Claim 16 (depends on 15)

The method of claim 15, wherein determining the initial noise, the convolution features, and the attention features comprises conducting a denoising diffusion implicit model (DDIM) inversion computation.

### Claim 17 (depends on 15)

The method of claim 15, wherein editing the first video frame comprises utilizing a diffusion model for single image editing.

### Claim 18 (depends on 15)

The method of claim 15, wherein generating the new video subclip comprises utilizing a U-Net-based image to video (I2V) latent diffusion model (LDM).

### Claim 19 (depends on 18)

The method of claim 18, wherein generating the new video subclip further comprises injecting the following into the U-Net-based I2V LDM:
some of the convolution features; and
some of the attention features.

### Claim 20 (depends on 15)

The method of claim 15, wherein generating the new video subclip further comprises injecting the following into a U-net-based diffusion model:
the estimated surface normal;
the estimated depth; and
the environment lighting condition.
