# US 12,602,849 B2 · Image generation using one-dimensional inputs

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,602,849 B2
- Document ID: US12602849B2
- Status: Granted
- Kind: B2
- Application number: 18/342,726
- Filed: 2023-06-27
- Published: 2024-07-04
- Granted: 2026-04-14
- Earliest claimed: 2022-12-30
- Assignees: Samsung Electronics Co., Ltd.
- Applicants: Samsung Electronics Co., Ltd.
- Inventors: Hyun Jae Kang; Siddarth Ravichandran; Ondrej Texler; Dimitar Petkov Dinev; Anthony Sylvain Jean-Yves Liot; Sajid Sadi
- Web page: https://patentgrep.com/patent/US12602849B2

## CPC

- G06T 13/40: of characters, e.g. humans, animals or virtual beings
- G06T 11/10: Texturing; Colouring; Generation of textures or colours (retouching, inpainting or scratch removal G06T5/77)
- G06T 11/60: Creating or editing images; Combining images with text
- G06T 13/205: {driven by audio data}
- G06T 13/80: Two-dimensional [2D] animation, e.g. using sprites
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

Image-to-image translations using 1D inputs includes concatenating multiple 1D vectors forming a concatenated 1D vector. The multiplicity of 1D vectors includes 1D vectors of at least two different modalities. An encoded 1D vector is generated by encoding the concatenated 1D vector. An encoded 2D array of features is generated by reshaping an arrangement of features of the encoded 1D feature vector. An image of a virtual human is generated by decoding the encoded 2D array.

## Claims

### Claim 1

A computer-implemented method, comprising:
concatenating a plurality of 1D vectors forming a concatenated 1D vector, wherein the plurality of 1D vectors include 1D vectors of at least two different modalities;
generating an encoded 1D feature vector by encoding the concatenated 1D vector;
generating an encoded 2D array of features by reshaping an arrangement of features of the encoded 1D feature vector; and
generating an image of a virtual human by decoding the encoded 2D array.

### Claim 2 (depends on 1)

The computer-implemented method of claim 1, further comprising:
generating a video rendering of the virtual human, wherein the video rendering includes the image of the virtual human.

### Claim 3 (depends on 1)

The computer-implemented method of claim 1, wherein each 1D vector of the plurality of 1D vectors is of a different modality.

### Claim 4 (depends on 1)

The computer-implemented method of claim 1, wherein the plurality of 1D vectors includes a 1D vector having a first modality including head pose information.

### Claim 5 (depends on 1)

The computer-implemented method of claim 1, wherein the plurality of 1D vectors includes a 1D vector having a second modality including features representing audio data.

### Claim 6 (depends on 5)

The computer-implemented method of claim 5, wherein the features representing audio data includes a plurality of viseme coefficients.

### Claim 7 (depends on 1)

The computer-implemented method of claim 1, wherein the plurality of 1D vectors includes a 1D vector with features comprising blend shape coefficients.

### Claim 8

A computer-implemented method, comprising:
generating an encoded 2D image template by encoding a 2D static template image;
generating an encoded 1D feature vector by encoding a concatenation of a plurality of 1D vectors;
generating an encoded 2D array of features by reshaping an arrangement of multiple features of the encoded 1D feature vector;
concatenating the encoded 2D image template and the encoded 2D array of features;
generating a fused tensor by fusing the encoded 2D image template with the encoded 2D array of features; and
generating an image of a virtual human by decoding the fused tensor, wherein the image of the virtual human is changeable to a different virtual human in response to encoding a different 2D static template image.

### Claim 9 (depends on 8)

The computer-implemented method of claim 8, further comprising:
generating a video rendering of the virtual human, wherein the video rendering includes the image of the virtual human.

### Claim 10 (depends on 8)

The computer-implemented method of claim 8, further comprising:
changing at least one visual characteristic of the image of the virtual human in response to encoding a different concatenation of 1D vectors.

### Claim 11 (depends on 10)

The computer-implemented method of claim 10, wherein the changing at least one visual characteristic includes changing a direction of illumination of the image of the virtual human.

### Claim 12 (depends on 8)

The computer-implemented method of claim 8, wherein the concatenating concatenates the encoded 2D image template and the encoded 2D array of features along a channel dimension.

### Claim 13 (depends on 8)

The computer-implemented method of claim 8, wherein the generating the encoded 1D feature vector includes encoding a concatenation of a plurality of 1D vectors that each comprise multiple features corresponding to different modalities.

### Claim 14 (depends on 8)

The computer-implemented method of claim 8, wherein the plurality of 1D vectors includes a 1D vector whose features include head pose information.

### Claim 15 (depends on 8)

The computer-implemented method of claim 8, wherein the plurality of 1D vectors includes a 1D vector whose features comprise blend shape coefficients.

### Claim 16 (depends on 8)

The computer-implemented method of claim 8, wherein the plurality of 1D vectors includes a 1D vector comprising a plurality of features representing audio data.

### Claim 17 (depends on 16)

The computer-implemented method of claim 16, wherein the plurality of features representing audio data includes a plurality of viseme coefficients.

### Claim 18

A computer-implemented method, comprising:
generating an encoded 2D image template by encoding a 2D static template image;
generating an encoded 1D feature vector by encoding a concatenation of a plurality of 1D vectors;
generating an encoded 2D array of features by reshaping an arrangement of multiple features of the encoded 1D feature vector;
concatenating the encoded 2D image template and the encoded 2D array of features;
generating a fused tensor by fusing the encoded 2D image template with the encoded 2D array of features; and
generating an image of a virtual human by decoding the fused tensor, wherein at least one visual characteristic of the image of the virtual human is changeable in response to encoding a different concatenation of 1D vectors.

### Claim 19 (depends on 18)

The computer-implemented method of claim 18, further comprising:
generating a video rendering of the virtual human, wherein the video rendering includes the image of the virtual human.

### Claim 20 (depends on 18)

The computer-implemented method of claim 18, wherein the generating the encoded 1D feature vector includes encoding a concatenation of a plurality of 1D vectors that each comprise multiple features corresponding to different modalities.