Back to results
US 12,597,201 B2Granted
Interactive method and system for displaying measurements of objects and surfaces using co-registered images and 3D points
AssigneeReconstruct Inc.
InventorsJae Yong Lee, Derek Hoiem
Life of this patent
Estimating the term…
Abstract
A scene is displayed from a first view, control points are designated within the scene, and 3D positions of the control points are computed. Thereafter, the scene and each respective control point is displayed from a second view, and the locations of the control points are adjusted as necessary to correspond to their desired locations in the second view. New 3D positions for the control points are computed accordingly. A measurement is determined based on the computed 3D positions of the control points, and the measurement is displayed via a graphical user interface.
Claims12
A method to display a measurement using an interactive system, comprising:
- a. receiving, by the system, two or more co-registered images of a scene and corresponding three-dimensional (3D) scene geometry;
- b. displaying, by the system, the scene from a first view by presenting to a user, via a graphical user interface on a display, a first of the co-registered images;
- c. accepting, from the user, designations of a plurality of desired control points within the scene, each of said designations corresponding to a user-selection of a corresponding pixel coordinate in the first of the co-registered images via the graphical user interface and a cursor control device of the interactive system;
- d. computing 3D positions of each respective control point based on the corresponding 3D scene geometry and a respective first 3D ray originating from a first viewpoint associated with the first view through a corresponding user-selected pixel in the first of the co-registered images;
- e. displaying the scene and each respective control point from a second view corresponding to a second one of the co-registered images that is distinct from the first view, wherein each respective control point is displayed as a corresponding pixel coordinate in the second of the co-registered images;
- f. receiving from the cursor control device adjustments to at least one of the pixel coordinates in the second of the co-registered images corresponding to at least one of the control points in the second view, and, responsive thereto, automatically computing, for each of the adjusted at least one of the pixel coordinates, (i) a second 3D ray originating from a second viewpoint associated with the second view and based on the adjusted pixel coordinate and (ii) a new 3D position for the at least one control point based on the respective first 3D ray originating from the first viewpoint and the second 3D ray originating from the second viewpoint, wherein the adjustments by the cursor control device comprises at least one adjusted pixel coordinate in the second one of the co-registered images;
- and
- g. computing a measurement based on the computed 3D positions of the control points and displaying the measurement via the graphical user interface.
5 more elements
An interactive system comprising a processor and a memory coupled to the processor, the memory storing instructions which, when executed by the processor, cause the processor to perform steps comprising:
- a. displaying, via a display communicably coupled to the processor, a scene from a first view by presenting, via a graphical user interface displayed on the display, a first of two or more co-registered images;
- b. accepting, via an input received through the graphical user interface and a cursor control device of the interactive system, designations of a plurality of desired control points within the scene, each of said designations corresponding to a corresponding pixel coordinate in the first of the co-registered images;
- c. computing 3D positions of each respective control point based on 3D scene geometry corresponding to the two or more co-registered images and a respective first 3D ray originating from a first viewpoint associated with the first view through a corresponding user-selected pixel in the first of the co-registered images;
- d. displaying, via the graphical user interface displayed on the display, the scene and each respective control point from a second view corresponding to a second one of the co-registered images that is distinct from the first view, wherein each respective control point is displayed as a corresponding pixel coordinate in the second of the co-registered images;
- e. receiving, via an input received through the graphical user interface and a cursor control device of the interactive system, adjustments to at least one of the pixel coordinates in the second of the co-registered images corresponding to at least one of the control points in the second view, and, responsive thereto, automatically computing, for each one of the adjusted at least one pixel coordinates, (i) a second 3D ray originating from a second viewpoint associated with the second view and based on the adjusted pixel coordinate and (ii) a new 3D position for the at least one control point based on the respective first 3D ray originating from the first viewpoint and the second 3D ray originating from the second viewpoint, wherein the adjustments by the cursor control device comprises at least one adjusted pixel coordinate in the second one of the co-registered images;
- and
- f. computing a measurement based on the computed 3D positions of the control points and displaying the measurement via the graphical user interface.
4 more elements
Dependencies are inferred from the claim text.