# US 2021/0334266 A1 · Embedding codebooks for resource optimization

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0334266 A1
- Document ID: US20210334266A1
- Status: Published application
- Kind: A1
- Application number: 17/369,527
- Filed: 2021-07-07
- Published: 2021-10-28
- Earliest claimed: 2017-10-19
- Assignees: Adobe Inc.
- Applicants: Adobe Inc.
- Inventors: VISWANATHAN SWAMINATHAN; SAAYAN MITRA
- Web page: https://patentgrep.com/patent/US20210334266A1

## CPC

- G06F 16/2365: {Ensuring data consistency and integrity}
- G06F 16/5862: {using texture}
- H03M 7/30: Compression (speech analysis-synthesis for redundancy reduction G10L19/00; for image communication H04N); Expansion; Suppression of unnecessary data, e.g. redundancy reduction
- H03M 7/6088: {according to the data type}
- H04N 21/21: Server components or server architectures
- H04N 21/6336: directed to decoder
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- H03M: CODING; DECODING; CODE CONVERSION IN GENERAL (using fluidic means F15C4/00; optical analogue/digital converters G02F7/00; coding, decoding or code conversion, specially adapted for particular applications, see the relevant subclasses, e.g. G01D, G01R, G06F, G06T, G09G, G10L, G11B, G11C, H04B, H04L, H04M, H04N; ciphering or deciphering for cryptography or other purposes involving the need for secrecy G09C)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Embodiments of the present disclosure provide systems, methods, and computer storage media for optimizing computing resources generally associated with cloud-based media services. Instead of decoding digital assets on-premises to stream to a remote client device, an encoded asset can be streamed to the remote client device. A codebook employable for decoding the encoded asset can be embedded into the stream transmitted to the remote client device, so that the remote client device can extract the embedded codebook, and employ the extracted codebook to decode the encoded asset locally. In this way, not only are processing resources associated with on-premises decoding eliminated, but on-premises storage of codebooks can be significantly reduced, while expensive bandwidth is freed up by virtue of transmitting a smaller quantity of data from the cloud to the remote client device.

## Claims

### Claim 1

A computer-implemented method for offloading decoding resources to remote client devices, comprising:
training a codebook based on a set of digital assets, the codebook being trained to decode at least an encoded portion of a first digital asset in the set of digital assets;
transmitting at least a first data stream to a remote client device, the first data stream including the encoded portion of the first digital asset; and
amortizing the codebook into at least the first data stream as the first data stream is transmitted, wherein the remote client device is configured to employ one or more received portions of the amortized codebook to decode the encoded portion of the first digital asset as the encoded portion is received via the first data stream.

### Claim 2 (depends on 1)

The method of claim 1, wherein the set of digital assets is associated with a usage history of the remote client device.

### Claim 3 (depends on 1)

The method of claim 1, wherein the set of digital assets is associated with a user preference associated with the remote client device.

### Claim 4 (depends on 1)

The method of claim 1, wherein each digital asset of the set of digital assets includes one of a set of different representations of a common content.

### Claim 5 (depends on 1)

The method of claim 1, wherein each digital asset of the set of digital assets includes one of a set of different pieces of content, each piece of content of the set of different pieces of content having at least one common asset characteristic.

### Claim 6 (depends on 1)

The method of claim 1, wherein a second data stream including at least an encoded portion of a second digital asset in the set of digital assets is transmitted to the remote client device.

### Claim 7 (depends on 6)

The method of claim 6, wherein the remote client device is configured to employ the one or more received portions of the amortized codebook to decode the encoded portion of the second digital asset as the encoded portion of the second digital asset is received via the second data stream.

### Claim 8 (depends on 1)

The method of claim 1, wherein the codebook is amortized into at least the first data stream based on a determination that the codebook has not been previously transmitted to the remote client device.

### Claim 9 (depends on 1)

The method of claim 1, wherein the first data stream corresponds to a channel selected from a plurality of channels.

### Claim 10

A computer-implemented method for offloading decoding resources to remote client devices comprising:
receive at least a first data stream transmitted from a remote computing device, wherein a codebook that was generated based at least in part on an encoding of at least a portion of a first digital asset is amortized into at least the first data stream;
reconstruct at least a portion of the amortized codebook based at least in part on a received portion of the first data stream; and
employ at least the reconstructed portion of the amortized codebook to decode at least a portion of the first digital asset received via the first data stream.

### Claim 11 (depends on 10)

The method of claim 10, wherein the codebook was generated based further in part on an encoding of a second digital asset.

### Claim 12 (depends on 11)

The method of claim 11, wherein the second digital asset is included in a second data stream transmitted from the remote computing device, and the reconstructed portion of the codebook is employable to decode at least a portion of the first digital asset and the second digital asset.

### Claim 13 (depends on 10)

The method of claim 10, wherein the codebook was generated based further in part on an encoding of a second digital asset having content that is different than the first digital asset and at least one asset characteristic that is similar to the first digital asset.

### Claim 14 (depends on 10)

The method of claim 10, wherein the codebook is amortized into at least the first data stream and a second data stream transmitted from the remote computing device, and at least the portion of the amortized codebook is reconstructed based at least in part on a received portion of the first data stream and a received portion of the second data stream.

### Claim 15 (depends on 10)

The method of claim 10, further comprising:
determine that the reconstructed portion of the codebook is employable to decode at least a portion of a second digital asset received via a second data stream transmitted from the remote computing device; and
employ the reconstructed portion of the codebook to decode at least a portion of the second digital asset.

### Claim 16 (depends on 10)

The method of claim 10, wherein the amortized codebook includes a modification to a locally-stored codebook, and at least the portion of the amortized codebook is reconstructed based on the locally-stored codebook and the received portion of the first data stream.

### Claim 17

A computer-implemented method for offloading decoding resources to remote client devices, comprising:
training a codebook based on a set of digital assets associated with a usage history of a remote client device, the codebook being trained to decode at least an encoded portion of a first digital asset having at least one asset characteristic in common with the set of digital assets;
transmitting at least a first data stream to the remote client device, the first data stream including the encoded portion of the first digital asset; and
amortizing the codebook into at least the first data stream as at least the first data stream is transmitted, wherein the remote client device is configured to employ one or more received portions of the amortized codebook to decode the encoded portion of the first digital asset as the encoded portion is received via the first data stream.

### Claim 18 (depends on 17)

The method of claim 17, wherein the set of digital assets is selected from a plurality of digital assets based on the usage history of the remote client device.

### Claim 19 (depends on 18)

The method of claim 18, wherein the usage history includes a history of digital assets accessed via the remote client device.

### Claim 20 (depends on 18)

The method of claim 18, wherein the set of digital assets is further associated with a set of user preferences associated with the remote client device and the set of digital assets is selected from the plurality of digital assets based further on the set of user preferences.
