Image annotation
AssigneeFive AI Limited
InventorsThomas Westmacott, Brook Roberts, John Redford
Life of this patent
Estimating the term…
Abstract
A method of annotating road images, the method comprising implementing, at an image processing system, the following steps: receiving a time sequence of two dimensional images as captured by an image capture device of travelling vehicle; processing the images to reconstruct, in three-dimensional space, a path travelled by the vehicle; using the reconstructed vehicle path to determine expected road structure extending along the reconstructed vehicle path; and generating road annotation data for marking at least one of the images with an expected road structure location, by performing a geometric projection of the expected road structure in three-dimensional space onto a two-dimensional plane of that image.
Claims20
An image annotation system comprising:
- an input configured to receive a sequence of two-dimensional images captured by an image capture device of a vehicle;
- memory holding computer-readable instructions;
- and
- one or more hardware processors coupled to the memory, the computer-readable instructions configured, when executed by the one or more hardware processors, to cause the image annotation system to:
- generate a three-dimensional structure model of an environment travelled by the vehicle whilst capturing the images;
- determine, for each of the captured images, a corresponding location and orientation of the image capture device within the environment when that image was captured;
- generate two-dimensional image annotation data for marking regions of the images corresponding to the three-dimensional structure model, by geometrically projecting the three-dimensional structure model onto an image plane of each image that is defined by the corresponding image capture device location and orientation;
- render at least one of the images and its two-dimensional image annotation data via a user interface;
- and
- adapt the three-dimensional structure model according to instructions received via the user interface,
- wherein the computer-readable instructions further configure the image annotation system to modify the two-dimensional image annotation data for each of the captured images based on the adapted three-dimensional structure model, and to render the modified annotation data for the at least one image via the user interface, thereby allowing a user to effect modifications of the two-dimensional image annotation data for multiple captured images simultaneously, using the at least one image and its two-dimensional image annotation data as a reference.
A computer program product comprising instructions stored on a non-transitory computer-readable storage medium and configured, when executed on one or more processors, to implement operations comprising:
- receiving a sequence of two-dimensional images captured by an image capture device of a vehicle;
- generating a three-dimensional structure model of an environment travelled by the vehicle whilst capturing the images;
- determining, for each of the captured images, a corresponding location and orientation of the image capture device within the environment when that image was captured:
- generating two-dimensional image annotation data for marking regions of the images corresponding to the three-dimensional structure model, by geometrically projecting the three-dimensional structure model onto an image plane of each image that is defined by the corresponding image capture device location and orientation:
- rendering at least one of the images and its two-dimensional image annotation data via a user interface;
- adapting the three-dimensional structure model according to instructions received via the user interface, modifying the two-dimensional image annotation data for each of the captured images based on the adapted three-dimensional structure model;
- and rendering the modified annotation data for the at least one image via the user interface, thereby allowing a user to effect modifications of the two-dimensional image annotation data for multiple captured images simultaneously, using the at least one image and its two-dimensional image annotation data as a reference.
A method comprising implementing, at an image annotation system, steps of:
- receiving a sequence of two-dimensional images captured by an image capture device of a vehicle;
- generating a three-dimensional structure model of an environment travelled by the vehicle whilst capturing the images;
- determining, for each of the captured images, a corresponding location and orientation of the image capture device within the environment when that image was captured;
- generating two-dimensional image annotation data for marking regions of the images corresponding to the three-dimensional structure model, by geometrically projecting the three-dimensional structure model onto an image plane of each image that is defined by the corresponding image capture device location and orientation;
- rendering at least one of the images and its two-dimensional image annotation data via a user interface;
- adapting the three-dimensional structure model according to instructions received via the user interface, modifying the two-dimensional image annotation data for each of the captured images based on the adapted three-dimensional structure model, and rendering the modified annotation data for the at least one image via the user interface, thereby allowing a user to effect modifications of the two-dimensional image annotation data for multiple captured images simultaneously, using the at least one image and its two-dimensional image annotation data as a reference.
Dependencies are inferred from the claim text.