# US 2019/0087981 A1 · System and method for coding and decoding of an asset having transparency

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0087981 A1
- Document ID: US20190087981A1
- Status: Published application
- Kind: A1
- Application number: 16/133,880
- Filed: 2018-09-18
- Published: 2019-03-21
- Earliest claimed: 2017-09-21
- Assignees: Tiny Pixels Technologies Inc.
- Applicants: Tiny Pixels Technologies Inc.
- Inventors: Hsiehyu FUH; June Yan Lin CHEN
- Web page: https://patentgrep.com/patent/US20190087981A1

## CPC

- G06T 11/10: Texturing; Colouring; Generation of textures or colours (retouching, inpainting or scratch removal G06T5/77)
- H04N 1/3871: {the composed originals being of different kinds, e.g. low- and high-resolution originals}
- G06V 20/41: {Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items (segmenting video sequences G06V20/49)}
- H04N 1/6008: {with primary colour signals, e.g. RGB or CMY(K)}
- H04N 19/00: Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N 19/21: with binary alpha-plane coding for video objects, e.g. context-based arithmetic encoding [CAE]
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

A system and method for coding and decoding of an asset having transparency. The method for coding of an asset includes: receiving the asset; obtaining a frame image for each frame in the asset, the frame image having an integer value for each of a red channel, a green channel, a blue channel, and a transparent channel; generating a first sub-image and a second sub-image from each frame image, the first sub-image including a mask derived from the transparent channel, the second sub-image including a red channel, a green channel, and a blue channel derived from the red channel, the green channel, and the blue channel of the frame image respectively; placing the first sub-image in proximity to the second sub-image; and generating a combined asset including a series of combined frames, each combined frame including the first first sub-image in proximity to the second sub-image.

## Claims

### Claim 1

A method for coding of an input asset, the input asset having at least one area comprising a transparency, the input asset comprising one or more sequential frames, the method executed on at least one processing unit, the method comprising:
receiving the input asset;
obtaining a frame image for each frame in the input asset, the frame image having a value for each of a red channel, a green channel, a blue channel, and a transparent channel;
generating a first sub-image and a second sub-image from each frame image, the first sub-image comprising a mask generated from the transparent channel, the second sub-image comprising a red channel, a green channel, and a blue channel generated from the red channel, the green channel, and the blue channel of the frame image respectively;
associating the first sub-image with the second sub-image; and
generating a combined asset comprising one or more sequential combined frames, each combined frame comprising the first sub-image in association with the second sub-image.

### Claim 2 (depends on 1)

The method of claim 1, wherein the associating the first sub-image with the second sub-image comprises placing the first sub-image in proximity to the second sub-image.

### Claim 3 (depends on 2)

The method of claim 2, wherein the first sub-image is generated by assigning, for each pixel, the value for such pixel in the transparent channel to the value for a respective pixel in at least one of the red channel, green channel, and blue channel of the mask.

### Claim 4 (depends on 3)

The method of claim 3, wherein the value of each channel for each pixel in the mask ranges from zero to a maximum value, where zero represents full transparency and the maximum value represents no transparency.

### Claim 5 (depends on 2)

The method of claim 2, wherein placing the first sub-image in proximity to the second sub-image comprises stacking the first sub-image adjacently above the second sub-image, the width of the combined frame being equal to a width of the first sub-image and the height of the combined frame being equal to twice a height of the first sub-image.

### Claim 6 (depends on 2)

The method of claim 2, wherein each frame in the input asset comprises an associated duration, the method further comprising associating a duration for each combined frame equivalent to the duration associated with the respective frame in the input asset.

### Claim 7 (depends on 3)

The method of claim 3, further comprising decoding of the combined asset, the decoding comprising:
generating one or more sequential first portions and one or more sequential second portions by splitting each combined frame, the first portion comprising substantially the first sub-image, the second portion comprising substantially the second sub-image;
generating one or more sequential output frames in an output asset by:
for each frame, assigning a value for a red channel, a green channel, and a blue channel for each pixel of the output asset frame with the value of the red channel, the green channel, and the blue channel of the respective pixel in the first portion respectively; and
for each frame, assigning a value for a transparent channel for each pixel of the output asset frame with the value of a respective pixel in the second portion.

### Claim 8 (depends on 7)

The method of claim 7, wherein the value of the transparent channel in the output asset is assigned the value of any one of the red channel, the green channel, and the blue channel in the combined frame that was assigned the value of the transparent channel of the frame image.

### Claim 9 (depends on 7)

The method of claim 7, wherein each combined frame comprises an associated duration, the method further comprising associating a duration for each frame of the output asset equivalent to the duration associated with the respective combined frame.

### Claim 10 (depends on 1)

The method of claim 1, further comprising overlaying the combined asset over a source media, the source media comprising one or more sequential frames, by:
generating a first element comprising the source media;
generating a hidden second element comprising the combined asset;
generating a canvas element, pixels of the canvas element are transparent as default;
placing the transparent canvas element over the first element;
for each frame of the first video element, for each pixel in the second element, determining a value for a corresponding pixel in the canvas element as a combination of channel values of the corresponding pixel in the second sub-image and mask value of the corresponding pixel in the first sub-image; and
synchronizing playback of the second video element with the first video element.

### Claim 11 (depends on 1)

The method of claim 1, further comprising generating a size-adjusted combined asset from the combined asset, by:
for each red, green, and blue channel in each pixel in each frame of the combined asset, determining a value for a corresponding channel of a corresponding pixel of a corresponding frame of the size-adjusted combined asset as a combination of the value from the input asset, the first sub-image and the second sub-image.

### Claim 12 (depends on 11)

The method of claim 11, wherein the combination is determined as the value from the first sub-image divided by the maximum channel value, multiplied by the value from the second sub-image, and added to the value from the input asset.

### Claim 13

A method for decoding of a combined asset, the combined asset comprising one or more sequential combined frames, each combined frame comprising a first sub-image in proximity to a second sub-image, the method executed on at least one processing unit, the method comprising:
receiving the combined asset;
generating one or more sequential first portions and one or more sequential second portions by splitting each combined frame, the first portion comprising substantially the first sub-image, the second portion comprising substantially the second sub-image; and
generating one or more sequential output frames in an output asset by:
for each frame, assigning a value for a red channel, a green channel, and a blue channel for each pixel of the output asset frame with a value of the red channel, the green channel, and the blue channel of a respective pixel in the first portion respectively; and
for each frame, assigning a value for a transparent channel for each pixel of the output asset frame with a value of a respective pixel in the second portion.

### Claim 14 (depends on 13)

The method of claim 13, wherein the value of the transparent channel in the output asset is assigned the value of any one of a red channel, a green channel, and a blue channel in the combined frame that was assigned a value of the transparent channel of a frame image of an asset coded into the combined asset.

### Claim 15 (depends on 13)

The method of claim 13, wherein each frame in the combined asset comprises an associated duration, the method further comprising associating a duration for each frame of the output asset equivalent to the duration associated with the respective combined frame.

### Claim 16

A system for coding of an input asset, the input asset having at least one area comprising a transparency, the asset comprising one or more sequential frames, the system comprising at least one processing unit and a data storage, the at least one processing unit in communication with the data storage and configured to execute:
an obtainment module to receive the input asset, and obtain a frame image for each frame in the input asset, the frame image having a value for each of a red channel, a green channel, a blue channel, and a transparent channel;
a coding module to generate a first sub-image and a second sub-image from each frame image, the first sub-image comprising a mask generated from the transparent channel, the second sub-image comprising a red channel, a green channel, and a blue channel generated from the red channel, the green channel, and the blue channel of the frame image respectively, and associate the first sub-image with the second sub-image; and
a compiler module to generate a combined asset comprising one or more sequential combined frames, each combined frame comprising the first sub-image associated with the second sub-image.

### Claim 17 (depends on 16)

The system of claim 16, wherein the first sub-image is associated with the second sub-image by placing the first sub-image in proximity to the second sub-image.

### Claim 18 (depends on 17)

The system of claim 17, wherein the first sub-image is generated by assigning, for each pixel, the value for such pixel in the transparent channel to the value for a respective pixel in at least one of the red channel, green channel, and blue channel of the mask.

### Claim 19 (depends on 17)

The system of claim 17, further comprising a decoding module to decode the combined asset, by:
generating one or more sequential first portions and one or more sequential second portions by splitting each combined frame, the first portion comprising substantially the first sub-image, the second portion comprising substantially the second sub-image;
generating one or more sequential output frames in an output asset by:
for each frame, assigning a value for a red channel, a green channel, and a blue channel for each pixel of the output asset frame with the value of the red channel, the green channel, and the blue channel of the respective pixel in the first portion respectively; and
for each frame, assigning a value for a transparent channel for each pixel of the output asset frame with the value of a respective pixel in the second portion.

### Claim 20 (depends on 17)

The system of claim 17, further comprising a compiler module to overlay the combined asset over a source media, the source media comprising one or more sequential frames, by:
generating a first element comprising the source media;
generating a hidden second element comprising the combined asset;
generating a canvas element, pixels of the canvas element are transparent as default;
placing the transparent canvas element over the first element;
synchronizing playback of the second video element with the first video element;
and
for each frame of the first video element, for each pixel in the second element, determining a value for a corresponding pixel in the canvas element as a combination of channel values of the corresponding pixel in the second sub-image and mask value of the corresponding pixel in the first sub-image.
