Patch tracking image sensor

A method of operating a computing system comprising a sensor worn by a user and a processor configured to process image information, the sensor comprising an image array of a plurality of pixel cells generating image information for respective regions in a field of view of the sensor, the method comprising:

• analyzing one or more images depicting a vicinity of the user;
• identifying, based on analyzing the one or more images, an object in a physical world in the vicinity of the user;
• identifying a patch based at least in part on a portion of the identified object;
• selectively providing, from the sensor to the processor, image information from a portion of the plurality of pixels based at least in part on correspondence between the patch and the portion of the plurality of pixel cells;
• estimating a trajectory of the patch among the plurality of pixels with respect to coordinates of the image array, the estimating comprising:
• constructing a model of the object's motion in the physical world and a model of the image array's motion with respect to the physical world;
• and
• computing the trajectory based on the model of the object's motion within the physical world and the model of the image array's motion with respect to the physical world;
• and
• enabling a plurality of portions of the plurality of pixels cells of the sensor at different times based at least in part on the estimated trajectory of the path, wherein the plurality of portions of the plurality of pixel cells comprises the portion of the plurality of pixel cells, wherein enabling the portion of the plurality of pixel cells of the sensor comprises setting a first threshold value for the portion of the plurality of pixel cells and a second threshold for pixel cells outside the portion, the second threshold being greater than the first threshold.

A method of operating a computing system comprising a sensor worn by a user and a processor configured to process image information, the sensor comprising an image array of a plurality of pixel cells generating image information for respective regions in a field of view of the sensor, the method comprising:

• analyzing one or more images depicting a vicinity of the user;
• identifying, based on analyzing the one or more images, an object in a physical world in the vicinity of the user;
• identifying a portion of the plurality of pixel cells as a patch representing at least a portion of the identified object;
• selectively providing, from the sensor to the processor, image information from the portion of the plurality of pixels based at least in part on correspondence between the patch and the portion of the plurality of pixel cells;
• estimating a trajectory of the patch among the plurality of pixels, with respect to coordinates of the image array, based at least in part on the object represented by the portion of the plurality of pixels of the one or more images, the estimating comprising:
• constructing a model of the object's motion in the physical world and a model of the image array's motion with respect to the physical world;
• and
• computing the trajectory based on the model of the object's motion within the physical world and the model of the image array's motion with respect to the physical world;
• and
• updating a location of the patch among the plurality of pixels at least in part by enabling a plurality of portions of the plurality of pixels cells of the sensor at different times based at least in part on the estimated trajectory of the path, wherein the plurality of portions of the plurality of pixel cells comprises the portion of the plurality of pixel cells, wherein the different times are determined based at least in part on a shape of the estimated trajectory for the patch.

A computing device comprising:

• a support member;
• a sensor mechanically coupled to the support member, the sensor comprising an image array of a plurality of pixel cells generating image information for respective regions in a field of view of the sensor;
• a processor, operatively coupled to the sensor and configured to process image information from the sensor;
• a patch trajectory computing engine coupled to the sensor, the patch trajectory computing engine configured to:
• estimate a trajectory of a patch of pixels among the plurality of pixels with respect to coordinates of the image array, the estimating comprising:
• constructing a model of an object's motion in a physical world and a model of the image array's motion with respect to the physical world;
• and
• computing the trajectory based on the model of the object's motion within the physical world and the model of the image array's motion with respect to the physical world;
• dynamically modify a portion of the plurality of pixel cells included in the patch based on information indicating a position of the patch among the plurality of pixels at a first time and information indicating the trajectory of the patch among the plurality of pixels subsequent to the first time;
• and
• in a time period subsequent to the first time:
• control the sensor to selectively provide, to the processor, image information from the portion of the plurality of pixel cells in the patch without providing image information from pixel cells of the plurality of pixel cells that are outside of the patch.