US 11,454,976 B1Granted

Optimizing data levels for processing,transmission, or storage

AssigneeZoox, Inc.

InventorJesse Sol Levinson

Life of this patent

Estimating the term…

Loading patent…

Abstract

Techniques are discussed for determining a data level for portions of data for processing. In some cases, a data level can correspond to a resolution level, a compression level, a bit rate, and the like. In the context of image data, the techniques can determine a region of first image data to be processed a high resolution and a region of second image data to be processed at a low resolution. The regions can be determined by a machine learned algorithm that is trained to output identifications of such regions. Training data may be determined by identifying differences in outputs based on the first and second image data. The image data associated with the determined regions and the determined resolutions can be processed to perform object detection, classification, segmentation, bounding box generation, and the like, thereby conserving processing, bandwidth, and/or memory resources in real time systems.

Claims20

Dependent claims

A system comprising:

one or more processors;
and
one or more computer-readable media storing instructions executable by the one or more processors, wherein the instructions, when executed, cause the system to perform operations comprising:
capturing first data of an environment using a sensor of an autonomous vehicle, the first data associated with a first resolution;
determining, based on the first data, second data associated with a second resolution which differs from the first resolution;
inputting the second data to a machine learned model;
receiving, from the machine learned model, an identification of a first portion of the second data, the first portion representing a region of the environment;
determining a second portion of the first data associated with the first portion of the second data, wherein the region of the environment represented by the first portion represents the region of the environment represented by the second portion;
determining, based at least in part on the second portion of the first data, first information comprising one or more first detection information, first classification information, or first segmentation information;
determining, based at least in part on the first portion of the second data, second information comprising one or more second detection information, second classification information, or second segmentation information;
and
controlling the autonomous vehicle based at least in part on the first information and the second information.

9 more elements

Dependencies are inferred from the claim text.