# US 2025/0148647 A1 · Approaches for lossy compression using machine learning

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0148647 A1
- Document ID: US20250148647A1
- Status: Published application
- Kind: A1
- Application number: 19/016,670
- Filed: 2025-01-10
- Published: 2025-05-08
- Earliest claimed: 2020-12-17
- Assignees: Palantir Technologies Inc.
- Applicants: Palantir Technologies Inc.
- Inventors: Peter WILCZYNSKI
- Web page: https://patentgrep.com/patent/US20250148647A1

## CPC

- G06T 9/00: Image coding (bandwidth or redundancy reduction for static pictures H04N1/41; coding or decoding of static colour picture signals H04N1/64; methods or arrangements for coding, decoding, compressing or decompressing digital video signals H04N19/00)
- H04N 19/20: using video object coding
- G06N 3/045: Combinations of networks
- G06N 3/0464: Convolutional networks [CNN, ConvNet]
- G06N 3/09: Supervised learning
- G06N 20/00: Machine learning
- G06T 3/40: Scaling of whole images or parts thereof, e.g. expanding or contracting
- G06T 9/002: {using neural networks}
- H04N 19/132: Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
- H04N 19/162: User input
- H04N 19/167: Position within a video image, e.g. region of interest [ROI]
- H04N 19/17: the unit being an image region, e.g. an object
- G06N 3/048: Activation functions
- G06N 7/01: Probabilistic graphical models, e.g. probabilistic networks
- G10L 19/00: Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis (in musical instruments G10H)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING

## Abstract

Systems and methods are provided for obtaining a media, the media including an image, audio, video, or combination thereof. An input may be received regarding one or more features or frames of the media to be maintained in or removed from the media. One or more criteria of a lossy compression technique may be inferred based on the received input, using a machine learning model, based on the received input. The inferred criteria of the lossy compression technique may be applied to the media.

## Claims

### Claim 1

A computing system comprising:
one or more processors; and
memory storing instructions that, when executed by the one or more processors, cause the system to perform:
obtaining a media, the media including an image, audio, video, or combination thereof;
receiving an input regarding one or more features across one or more frames of the media to be maintained in or removed from the media, wherein the receiving of the input comprises receiving a selection, from the one or more features, of a first feature while a second feature remains unselected;
inferring a first criteria and a second criteria of a lossy compression technique, based on the received input, wherein the inferred first criteria is applied to any first features, from the one or more features, satisfying a degree of similarity of a classification or characteristic compared to the first feature and the inferred second criteria is applied to one or more second features, from the one or more features, failing to satisfy the degree of similarity of the classification or characteristic compared to the first feature; and
applying the inferred first criteria and the inferred second criteria of the lossy compression technique to the media, wherein the applying of the inferred first criteria and the inferred second criteria comprises applying the inferred first criteria to the any first features and applying the inferred second criteria to the one or more second features.

### Claim 2 (depends on 1)

The computing system of claim 1, wherein the instructions further cause the system to perform:
in response to applying the inferred first criteria and the inferred second criteria of the lossy compression technique, receiving an additional input;
adjusting the inferred first criteria or the inferred second criteria based on the additional input; and
reapplying the adjusted inferred first criteria or the adjusted inferred second criteria of the lossy compression technique to the media.

### Claim 3 (depends on 2)

The computing system of claim 2, wherein the applying of the inferred first criteria and the inferred second criteria comprises categorizing one or more additional features within the second features; and
the receiving of the additional input indicates that the one or more additional features are selected;
the adjusting of the inferred first criteria or the inferred second criteria comprises, in response to receiving the additional input, recategorizing the one or more additional features within the first features; and
the reapplying the adjusted inferred first criteria or the adjusted inferred second criteria comprises applying the first criteria to the one or more additional features.

### Claim 4 (depends on 1)

The computing system of claim 1, wherein the inferred first criteria or the inferred second criteria is determined based on a scale of a byte or a frame, the criteria indicating whether to downsample, compress, keep, or remove the byte or the frame.

### Claim 5 (depends on 4)

The computing system of claim 4, wherein the inferred first criteria or the inferred second criteria further comprises, in response to determining to remove the byte or the frame, determine whether to purge the byte or the frame or to store the byte or the frame in a tiered storage.

### Claim 6 (depends on 1)

The computing system of claim 1, wherein the instructions that, when performed by the one or more processors, further cause the computing system to perform:
generating a compressed version of the media by applying the lossy compression technique, the lossy compression technique resulting in compressed features; and
storing the compressed version and the compressed features of the media within a storage according to a storage criteria, wherein the storage criteria comprises storing portions of the compressed version or the compressed features that have higher information content or higher information value within a first location and portions of the compressed version or the compressed features having lower information content or lower information value within a second location, wherein the first location is configured to retrieve the compressed version of the unstructured information faster compared to the retrieving of the portions of the compressed features from the second location.

### Claim 7 (depends on 1)

The computing system of claim 1, wherein the inferred first criteria compresses the any first features at a first compression rate and the inferred second criteria compresses the one or more second features at a second compression rate.

### Claim 8 (depends on 7)

The computing system of claim 7, wherein the first compression rate is higher than the second compression rate.

### Claim 9 (depends on 7)

The computing system of claim 7, wherein the inferred first criteria and the inferred second criteria are applied to the any first features and the one or more second features within a same image frame.

### Claim 10 (depends on 1)

The computing system of claim 1, wherein the inferred first criteria or the inferred second criteria is based on relative amounts or rates of movement of the one or more features.

### Claim 11

A computer-implemented method, wherein the method is performed using one or more processors, the method comprising:
obtaining a media, the media including an image, audio, video, or combination thereof;
receiving an input regarding one or more features across one or more frames of the media to be maintained in or removed from the media, wherein the receiving of the input comprises receiving a selection, from the one or more features, of a first feature while a second feature remains unselected;
inferring a first criteria and a second criteria of a lossy compression technique, based on the received input, wherein the inferred first criteria is applied to any first features, from the one or more features, satisfying a degree of similarity of a classification or characteristic compared to the first feature and the inferred second criteria is applied to one or more second features, from the one or more features, failing to satisfy the degree of similarity of the classification or characteristic compared to the first feature; and
applying the inferred first criteria and the inferred second criteria of the lossy compression technique to the media, wherein the applying of the inferred first criteria and the inferred second criteria comprises applying the inferred first criteria to the any first features and applying the inferred second criteria to the one or more second features.

### Claim 12 (depends on 11)

The computer-implemented method of claim 11, further comprising:
in response to applying the inferred first criteria and the inferred second criteria of the lossy compression technique, receiving an additional input;
adjusting the inferred first criteria or the inferred second criteria based on the additional input; and
reapplying the adjusted inferred first criteria or the adjusted inferred second criteria of the lossy compression technique to the media.

### Claim 13 (depends on 12)

The computer-implemented method of claim 12, wherein the applying of the inferred first criteria and the inferred second criteria comprises categorizing one or more additional features within the second features; and
the receiving of the additional input indicates that the one or more additional features are selected;
the adjusting of the inferred first criteria or the inferred second criteria comprises, in response to receiving the additional input, recategorizing the one or more additional features within the first features; and
the reapplying the adjusted inferred first criteria or the adjusted inferred second criteria comprises applying the first criteria to the one or more additional features.

### Claim 14 (depends on 11)

The computer-implemented method of claim 11, wherein the inferred first criteria or the inferred second criteria is determined based on a scale of a byte or a frame, the criteria indicating whether to downsample, compress, keep, or remove the byte or the frame.

### Claim 15 (depends on 14)

The computer-implemented method of claim 14, wherein the inferred first criteria or the inferred second criteria further comprises, in response to determining to remove the byte or the frame, determine whether to purge the byte or the frame or to store the byte or the frame in a tiered storage.

### Claim 16 (depends on 11)

The computer-implemented method of claim 11, further comprising:
generating a compressed version of the media by applying the lossy compression technique, the lossy compression technique resulting in compressed features; and
storing the compressed version and the compressed features of the media within a storage according to a storage criteria, wherein the storage criteria comprises storing portions of the compressed version or the compressed features that have higher information content or higher information value within a first location and portions of the compressed version or the compressed features having lower information content or lower information value within a second location, wherein the first location is configured to retrieve the compressed version of the unstructured information faster compared to the retrieving of the portions of the compressed features from the second location.

### Claim 17 (depends on 11)

The computer-implemented method of claim 11, wherein the inferred first criteria compresses the any first features at a first compression rate and the inferred second criteria compresses the one or more second features at a second compression rate.

### Claim 18 (depends on 17)

The computer-implemented method of claim 17, wherein the first compression rate is higher than the second compression rate.

### Claim 19 (depends on 17)

The computer-implemented method of claim 17, wherein the inferred first criteria and the inferred second criteria are applied to the any first features and the one or more second features within a same image frame.

### Claim 20 (depends on 11)

The computer-implemented method of claim 11, wherein the inferred first criteria or the inferred second criteria is based on relative amounts or rates of movement of the one or more features.
