# US 11,026,560 B2 · Medical display control apparatus and display control method > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 11,026,560 B2 - Document ID: US11026560B2 - Status: Granted - Kind: B2 - Application number: 16/274,300 - Filed: 2019-02-13 - Published: 2019-09-19 - Granted: 2021-06-08 - Earliest claimed: 2018-03-15 - Assignees: Sony Olympus Medical Solutions Inc. - Applicants: Sony Olympus Medical Solutions Inc. - Inventors: Takaaki Yamada - Web page: https://patentgrep.com/patent/US11026560B2 ## CPC - A61B 1/0005: {combining images e.g. side-by-side, superimposed or tiled} - A61B 1/00009: {of image signals during a use of endoscope} - A61B 1/00045: {Display arrangement} - A61B 1/00188: {with focusing or zooming features} - A61B 1/00193: {adapted for stereoscopic vision} - A61B 90/25: Supports therefor - A61B 90/30: Devices for illuminating a surgical field, the devices having an interrelation with other surgical devices or with a surgical procedure - G02B 21/0012: {Surgical microscopes (counterbalanced structures for surgical microscopes G02B7/001)} - G02B 21/22: Stereoscopic arrangements - G02B 21/365: {Control or image processing arrangements for digital or video microscopes (G02B21/361, G02B21/362 take precedence)} - A61B 1/0638: {providing two or more wavelengths} - A61B 1/0646: {with illumination filters} - A61B 1/0661: {Endoscope light sources} - A61B 34/25: {User interfaces for surgical systems} - A61B 90/361: {Image-producing devices, e.g. surgical cameras} - A61B 90/37: {Surgical systems with images on a monitor during operation} - A61B 90/50: Supports for surgical instruments, e.g. articulated arms - A61B 90/92: coded with colour - A61B 2017/00203: {with speech control or speech recognition} - A61B 2017/00207: {with hand gesture control or hand gesture recognition} - A61B 2017/00212: {using remote controls} - A61B 2017/00429: {with a roughened portion} - A61B 2017/00734: {battery operated} - A61B 2017/00973: {pedal-operated} - A61B 2034/2059: {Mechanical position encoders} - A61B 2090/304: {using chemi-luminescent materials} - A61B 2090/371: {with simultaneous use of two cameras} - A61B 2090/372: {Details of monitor hardware} - A61B 2090/502: {Headgear, e.g. helmet, spectacles} - A61B 2090/508: {with releasable brake mechanisms} - G02B 2027/0185: {Displaying image at variable distance} - A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D) - G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS ## Abstract There is provided a medical display control apparatus including: a display control section configured to control a display of a medical captured image for a right eye and a medical captured image for a left eye captured by an imaging device that images an observation target on a display screen and a display of a pointer object on the display screen. The display control section causes the pointer object to be displayed in correspondence with a depth position of the medical captured image for the right eye and the medical captured image for the left eye. ## Claims ### Claim 1 A medical display control apparatus comprising: processing circuitry configured to control a display of a medical captured image for a right eye and a medical captured image for a left eye captured by an imaging device that images an observation target on a display screen at a depth position of the medical captured image for the right eye and the medical captured image for the left eye; before receiving a region deciding operation that decides a region pointed out by a pointer object, control a display of the pointer object on the display screen at a depth position in front of the depth position of the medical captured image for the right eye and the medical captured image for the left eye; move the pointer object in accordance with a move operation that moves the pointer object, while keeping the depth position of the pointer object to be in front of the depth position of the medical captured image for the right eye and the medical captured image for the left eye; set at least one of a shape and a size of the pointer object in accordance with a region setting operation that sets the at least one of the shape and the size of the pointer object, while keeping the depth position of the pointer object to be in front of the depth position of the medical captured image for the right eye and the medical captured image for the left eye; and in response to receiving the region deciding operation, cause the pointer object to be displayed in correspondence with the depth position of the medical captured image for the right eye and the medical captured image for the left eye at a location designated by the move operation and with the at least one of the shape and the size of the pointer object designated by the region setting operation, and cause the depth position of the pointer object to correspond with the depth position of the medical captured image for the right eye and the medical captured image for the left eye. ### Claim 2 (depends on 1) The medical display control apparatus according to claim 1, wherein the processing circuitry adjusts a depth position of the pointer object, and causes the pointer object to be displayed in correspondence with the depth position of the medical captured image for the right eye and the medical captured image for the left eye. ### Claim 3 (depends on 2) The medical display control apparatus according to claim 2, wherein the processing circuitry adjusts the depth position of the pointer object such that a sense of depth of the pointer object becomes a sense of depth of the medical captured image for the right eye and the medical captured image for the left eye. ### Claim 4 (depends on 2) The medical display control apparatus according to claim 2, wherein the processing circuitry adjusts the depth position of the pointer object such that the depth position of the pointer object approaches the depth position of the medical captured image for the right eye and the medical captured image for the left eye. ### Claim 5 (depends on 4) The medical display control apparatus according to claim 4, wherein the processing circuitry adjusts the depth position of the pointer object to the depth position of the medical captured image for the right eye and the medical captured image for the left eye. ### Claim 6 (depends on 1) The medical display control apparatus according to claim 1, where the processing circuitry controls the display of the pointer object on the display screen on a basis of a predetermined operation. ### Claim 7 (depends on 1) The medical display control apparatus according to claim 1, wherein the processing circuitry sets a display color of the pointer object to a color corresponding to a medical captured image displayed on the display screen, and the display color of the pointer object is changed according to a color of the medical captured image at a position on the display screen where the pointer object is displayed. ### Claim 8 (depends on 7) The medical display control apparatus according to claim 7, wherein the processing circuitry sets the display color of the pointer object to a complementary color of the color of the medical captured image at the position on the display screen where the pointer object is displayed. ### Claim 9 (depends on 7) The medical display control apparatus according to claim 7, wherein the processing circuitry sets the display color of the pointer object to a complementary color of a specific color among colors of the medical captured image included in a region pointed out by the pointer object. ### Claim 10 (depends on 9) The medical display control apparatus according to claim 9, wherein the specific color is a color with the most color components among the colors of the medical captured image included in the region pointed out by the pointer object. ### Claim 11 (depends on 1) The medical display control apparatus according to claim 1, further comprising: an arm including multiple links joined to each other by one or multiple joint sections; and the imaging device supported by the arm. ### Claim 12 (depends on 1) The medical display control apparatus according to claim 1, further comprising: the imaging device that is inserted into an inside of a body of a patient and images the inside of the body as the observation target. ### Claim 13 (depends on 1) The medical display control apparatus according to claim 1, wherein the medical captured image for the right eye has different image depths according to locations inside the medical captured image for the right eye, and the medical captured image for the left eye has different image depths according to locations inside the medical captured image for the left eye. ### Claim 14 (depends on 13) The medical display control apparatus according to claim 13, wherein the processing circuitry is configured to cause the pointer object to be displayed at each of the different image depths inside the region pointed out by the pointer object for both the medical captured image for the right eye and the medical captured image for the left eye, such that image depth of the pointer object changes according to a location inside the region pointed out by the pointer object. ### Claim 15 (depends on 14) The medical display control apparatus according to claim 14, wherein before receiving the region deciding operation that decides the region pointed out by the pointer object, the image depth of the pointer object is entirely at the depth position in front of the depth position of the medical captured age for the right eye and the medical captured image for the left eye, such that the image depth of the pointer object does not change according to the location inside the region pointed out by the pointer object. ### Claim 16 A display control method executed by a medical display control apparatus, the display control method comprising: controlling a display of a medical captured image for a right eye and a medical captured image for a left eye captured by an imaging device that images an observation target on a display screen at a depth position of the medical captured image for the right eye and the medical captured image for the left eye; before receiving a region deciding operation that decides a region pointed out by a pointer object, control a display of the pointer object on the display screen at a depth position in front of the depth position of the medical captured image for the right eye and the medical captured image for the left eye; moving the pointer object in accordance with a move operation that moves the pointer object, while keeping the depth position of the pointer object to be in front of the depth position of the medical captured image for the right eye and the medical captured image for the left eye; setting at least one of a shape and a size of the pointer object in accordance with a region setting operation that sets the at least one of the shape and the size of the pointer object, while keeping the depth position of the pointer object to be in front of the depth position of the medical captured image for the right eye and the medical captured image for the left eye; and in response to receiving the region deciding operation, causing, using processing circuitry, the pointer object to be displayed in correspondence with the depth position of the medical captured image for the right eye and the medical captured image for the left eye at a location designated by the move operation and with the at least one of the shape and the size of the pointer object designated by the region setting operation, and causing the depth position of the pointer object to correspond with the depth position of the medical captured image for the right eye and the medical captured image for the left eye.