Multi-point predictive foveation for bandwidth reduction of moving images
AssigneeSBC Technology Resources, Inc.
InventorsPhilip Ted Kortum, Marc Andrew Sullivan
Life of this patent
Estimating the term…
Abstract
A scene of an image sequence is compressed using a number of foveation zones, each foveation zone being weighted based on a probability of a viewer looking at a corresponding portion of the first scene. Another scene of the image sequence is compressed using a different number of foveation zones, each foveation zone being weighted based on a probability of a viewer looking at a corresponding portion of the second scene.
Claims30
A method comprising:
- compressing a first scene of an image sequence using a first plurality of foveation zones, each of the first plurality of foveation zones being weighted based on a probability of a viewer looking at a corresponding portion of the first scene;
- and
- compressing a second scene of the image sequence using a second plurality of foveation zones, each of the second plurality of foveation zones being weighted based on a probability of a viewer looking at a corresponding portion of the second scene;
- wherein the first plurality of foveations zones consists of a different number of foveations zones than the second plurality of foveations zones.
A method comprising:
- determining view locations within the first scene for a sample of viewers;
- determining a first plurality of foveation zones based on the view locations;
- estimating a probability for each of the foveation zones based on the view locations;
- weighting each of the foveation zones based on the probability;
- and
- compressing a first scene of an image sequence using the first plurality of foveation zones, each of the first plurality of foveation zones being weighted based on the probability of a viewer looking at a corresponding portion of the first scene.
A method comprising:
- determining a first plurality of foveation zones based on a scene type for a first scene;
- estimating a probability for each of the foveation zones based on the scene type for the first scene;
- weighting each of the foveation zones based on a probability;
- and
- compressing the first scene of an image sequence using the first plurality of foveation zones, each of the first plurality of foveation zones being weighted based on the probability of a viewer looking at a corresponding portion of the first scene.
A computer-readable medium having computer-readable instructions to direct a computer to perform acts of:
- compressing a first scene of an image sequence using a first plurality of foveation zones, each of the first plurality of foveation zones being weighted based on a probability of a viewer looking at a corresponding portion of the first scene;
- and
- compressing a second scene of the image sequence using a second plurality of foveation zones, each of the second plurality of foveation zones being weighted based on a probability of a viewer looking at a corresponding portion of the second scene;
- wherein the first plurality of foveations zones consists of a different number of foveations zones than the second plurality of foveations zones.
A computer-readable medium having computer-readable instructions to direct a computer to perform acts of:
- determining view locations within a first scene for a sample of viewers;
- determining a first plurality of foveation zones based on the view locations;
- estimating a probability for each of the foveation zones based on the view locations;
- weighting each of the foveation zones based on the probability;
- and
- compressing the first scene of an image sequence using the first plurality of foveation zones, each of the first plurality of foveation zones being weighted based on the probability of a viewer looking at a corresponding portion of the first scene.
A computer-readable medium having computer-readable instructions to direct a computer to perform acts of:
- determining a first plurality of foveation zones based on a scene type for a first scene;
- estimating a probability for each of the foveation zones based on the scene type for the first scene;
- weighting each of the foveation zones based on a probability;
- and
- compressing the first scene of an image sequence using the first plurality of foveation zones, each of the first plurality of foveation zones being weighted based on the probability of a viewer looking at a corresponding portion of the first scene.
An apparatus comprising:
- an image compressor to compress a first scene of an image sequence using a first plurality of foveation zones, each of the first plurality of foveation zones being weighted based on a probability of a viewer looking at a corresponding portion of the first scene;
- wherein the image compressor is further to compress a second scene of the image sequence using a second plurality of foveation zones, each of the second plurality of foveation zones being weighted based on a probability of a viewer looking at a corresponding portion of the second scene;
- and
- wherein the first plurality of foveations zones consists of a different number of foveations zones than the second plurality of foveations zones.
An apparatus comprising:
- at least one eye tracking device to determine view locations within a first scene for a sample of viewers;
- a processor responsive to the at least one eye tracking device to determine a first plurality of foveation zones based on the view locations, to estimate a probability for each of the foveation zones based on the view locations, and to weight each of the foveation zones based on a the probability;
- and
- an image compressor to compress the first scene of an image sequence using the first plurality of foveation zones, each of the first plurality of foveation zones being weighted based on the probability of a viewer looking at a corresponding portion of the first scene.
An apparatus comprising:
- a processor to determine a first plurality of foveation zones based on a scene type for a first scene, to estimate a probability for each of the foveation zones based on the scene type for the first scene, and to weight each of the foveation zones based on a probability;
- and
- an image compressor to compress the first scene of an image sequence using the first plurality of foveation zones, each of the first plurality of foveation zones being weighted based on the probability of a viewer looking at a corresponding portion of the first scene.
Dependencies are inferred from the claim text.