Back to results
US 11,057,602 B2Granted
Depth based modification of captured images
AssigneeIntuitive Surgical Operations, Inc.
InventorsAmy E. Kerdok, Wenyi Zhao
Life of this patent
Estimating the term…
Abstract
An imaging system processes images of a plurality of objects which have been captured by an image capture device for display. Normal processing of the images is modified as either a function of a depth corresponding to one or more of the plurality of objects appearing in the captured images relative to the image capture device or as a function of the depth and one or more image characteristics extracted from the captured images. A depth threshold may be used to avoid inadvertent modifications due to noise.
Claims20
An image processing and display method comprising:
- a processor receiving image information of a plurality of objects, wherein the image information corresponds to a stereo image which has been captured by an image capture device, wherein the plurality of objects includes one or more selected objects and at least one non-selected object, wherein the stereo image includes an image of the one or more selected objects and an image of the at least one non-selected object, wherein the selection of the one or more selected objects from the plurality of objects is independent of a first depth indicating a first distance from the image capture device to the one or more selected objects, and wherein the non-selection of the at least one non-selected object is independent of a second depth indicating a second distance from the image capture device to the at least one non-selected object;
- the processor generating modified image information by modifying, without changing a perspective of the plurality of objects in the stereo image, the image information of the one or more selected objects for at least one of color, brightness, and edge sharpness according to a function of at least the first depth, while maintaining a non-modified image of the at least one non-selected object by not modifying the image information of the at least one non-selected object regardless of the second depth, so that the modified image information corresponds to a modified stereo image, wherein the modified stereo image includes a modified image of the one or more selected objects and the non-modified image of the at least one non-selected object;
- and
- the processor providing the modified image information to a display controller for displaying the modified stereo image on a stereo display.
1 more element
An imaging system comprising:
- an image capture device, the image capture device disposed so as to capture a stereo image of a plurality of objects;
- a stereo display;
- and
- an image processor configured to:
- receive image information corresponding to the stereo image, wherein the plurality of objects includes one or more selected objects and at least one non-selected object, wherein the stereo image includes an image of the one or more selected objects and an image of the at least one non-selected object, wherein the selection of the one or more selected objects from the plurality of objects is independent of a first depth indicating a first distance from the image capture device to the one or more selected objects, and wherein the non-selection of the at least one non-selected object is independent of a second depth indicating a second distance from the image capture device to the at least one non-selected object;
- generate a modified processed image by modifying, without changing a perspective of the plurality of objects in the stereo image, the image information of the one or more selected objects for at least one of color, brightness, and edge sharpness according to a function of at least the first depth, while maintaining a non-modified image of the at least one non-selected object by not modifying the image information of the at least one non-selected object regardless of the second depth, to generate modified image information that corresponds to a modified stereo image, wherein the modified stereo image includes a modified image of the one or more selected objects and the non-modified image of the at least one non-selected object;
- and
- cause the modified stereo image to be displayed on the stereo display.
5 more elements
Dependencies are inferred from the claim text.