Utilizing prediction models of an environment
AssigneeShmuel Ur Innovation LTD.
InventorsShmuel Ur, Vlad Dabija, David Hirshberg
Life of this patent
Estimating the term…
Abstract
A method, system and product for utilizing prediction models of an environment. In one embodiment, using a model of an environment and based on a first scene of the environment, a predicted second scene of the environment is predicted. An observed second scene is obtained and compared to the predicted second scene. Based on the comparison between the predicted second scene and the observed second scene, an action is performed.
Claims21
A system comprising:
- one or more sensors configured to capture scenes of an environment, the environment comprises one or more physical objects;
- a processor configured to:
- obtain a computer-representation of a first scene of the environment from said one or more sensors;
- predict, using a model of the environment and based on the computer-representation of the first scene of the environment, a predicted second scene of the environment, the predicted second scene comprises predicted pixel values;
- obtain a computer-representation of a second observed second scene of the environment from said one or more sensors, the observed second scene comprises observed pixel values;
- determine a difference between the predicted second scene and the observed second scene based on different values of the predicted pixel values compared to the observed pixel values;
- and
- create a compressed computer-representation of the observed second scene, wherein the compressed computer-representation includes the determined difference between the predicted second scene and the observed second scene, thereby the computer-representation of the observed second scene can be reconstructed by predicting, using the model and the computer-representation of the first scene, the predicted second scene, and by applying the determined difference between the predicted second scene and the computer representation of the observed second scene.
A method comprising:
- obtaining a computer-representation of a first scene of an environment from one or more sensors, the environment comprises one or more physical objects, the one or more sensors are configured to capture scenes of the environment;
- predicting, using a model of the environment and based on the computer-representation of the first scene of the environment, a predicted second scene of the environment, the predicted second scene comprises predicted pixel values;
- obtaining a computer-representation of an observed second scene of the environment from the one or more sensors, the observed second scene comprises observed pixel values;
- determining a difference between the predicted second scene and the observed second scene based on different values of the predicted pixel values compared to the observed pixel values;
- and
- creating a compressed computer-representation of the observed second scene, wherein the compressed computer-representation includes the determined difference between the predicted second scene and the observed second scene, thereby the computer-representation of the observed second scene can be reconstructed by predicting, using the model and the computer representation of the first scene, the predicted second scene, and by applying the determined difference between the predicted second scene and the computer-representation of the observed second scene.
A method for uncompressing scene information from a compressed computer-representation of an observed scene, the method comprising:
- obtaining a computer-representation of a base scene, wherein the base scene and the observed scene are scenes captured by one or more sensors or portion thereof, the one or more sensors are configured to capture scenes of an environment, and the environment comprises one or more physical objects;
- predicting, using a model of the environment and based on the computer representation of the base scene of the environment, a predicted scene of the environment, the predicted scene comprises predicted pixel values;
- and
- obtaining from the compressed computer-representation a determined difference between the predicted scene and the observed scene, the determined difference is based on different values of the predicted pixel values and observed pixel values of the computer-representation of the observed scene;
- modifying the predicted scene of the environment based on the determined difference between the predicted scene and the observed scene to reconstruct the computer-representation of the observed scene.
Dependencies are inferred from the claim text.