# US 12,010,452 B2 · Endoscopic device, display image output method, computer-readable medium, and endoscopic system > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,010,452 B2 - Document ID: US12010452B2 - Status: Granted - Kind: B2 - Application number: 17/736,455 - Filed: 2022-05-04 - Published: 2022-08-18 - Granted: 2024-06-11 - Earliest claimed: 2019-11-05 - Assignees: Olympus Corporation - Applicants: Olympus Corporation - Inventors: Ryunosuke Matsushige; Hideyuki Wada; Aki Matsumoto; Takuya Ogura; Satoru Ono; Takahiro Yumoto; Sachiko Hashimoto; Tomomi Ouchi - Web page: https://patentgrep.com/patent/US12010452B2 ## CPC - H04N 5/2628: {Alteration of picture size, shape, position or orientation, e.g. zooming, rotation, rolling, perspective, translation} - A61B 1/00006: {of control signals} - A61B 1/00009: {of image signals during a use of endoscope} - A61B 1/00045: {Display arrangement} - H04N 23/555: {for picking-up images in sites, inaccessible due to their dimensions or hazardous conditions, e.g. endoscopes or borescopes} - A61B 1/0002: {provided with data storages} - A61B 1/012: characterised by internal passages or accessories therefor - A61B 1/05: characterised by the image sensor, e.g. camera, being in the distal end portion - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D) ## Abstract An endoscopic device generates an endoscopic image based on an image pickup signal generated by an image pickup device at a distal-end portion of an insertion portion, acquires channel information regarding a channel formed in the insertion portion, acquires angle information regarding a display angle of the endoscopic image, and generates and outputs a display image including a display endoscopic image generated based on modifying the endoscopic image based on the angle information, and a channel guide image generated based on the angle information and the channel information. ## Claims ### Claim 1 An endoscopic device comprising: a processor configured to: generate an endoscopic image; acquire channel information regarding each of at least two channels formed in an insertion portion of an endoscope; acquire angle information regarding a display angle of the endoscopic image; generate a display endoscopic image by modifying the endoscopic image based on the angle information; generate a channel guide image separate from the endoscopic image based on both the angle information and the channel information; and generate and output a display image including both the display endoscopic and the channel guide image, wherein the channel information includes information regarding angles of positions of channel outlets of respective ones of the two channels or of the channel guide image when the display angle of the endoscopic image is 0°, and/or information regarding angles of positions of the channel outlets or of the channel guide image when the display angle of the endoscopic image is 180°. ### Claim 2 (depends on 1) The endoscopic device according to claim 1, wherein: the display endoscopic image is generated by rotating the endoscopic image based on the angle information, and the channel guide image includes a guide indicating an outlet position of each of the channels, and a first display angle of the display endoscopic image corresponds to a second display angle of the channel guide image. ### Claim 3 (depends on 1) The endoscopic device according to claim 1, wherein the processor is configured to acquire the channel information from the endoscope. ### Claim 4 (depends on 1) The endoscopic device according to claim 1, further comprising: a memory configured to store the channel information, wherein the processor is configured to acquire the channel information from the memory. ### Claim 5 (depends on 4) The endoscopic device according to claim 4, wherein: the memory is configured to store respective pieces of channel information on a plurality of endoscopes having different classifications, and the processor is configured to acquire, from the memory, the channel information corresponding to a classification of the endoscope. ### Claim 6 (depends on 1) The endoscopic device according to claim 1, wherein the channel information includes an angle of an outlet position of each of the channels when the display angle of the endoscopic image is a predetermined angle. ### Claim 7 (depends on 1) The endoscopic device according to claim 1, wherein the channel information includes the channel guide image when the display angle of the endoscopic image is a predetermined angle. ### Claim 8 (depends on 7) The endoscopic device according to claim 7, wherein the predetermined angle is any of an angle of 0° or greater. ### Claim 9 (depends on 1) The endoscopic device according to claim 1, wherein the processor is configured to determine whether or not an instruction to rotate the endoscopic image has been received; and in response to determining that the instruction has been received, the processor is configured to acquire the angle information. ### Claim 10 (depends on 1) The endoscopic device according to claim 1, wherein: the at least two channels include a first channel and a second channel, the channel information includes information regarding the first channel and the second channel formed, and the channel guide image is a guide for respective outlet positions of the first channel and the second channel. ### Claim 11 (depends on 2) The endoscopic device according to claim 2, wherein the channel guide image is a guide indicating the outlet position of the channel and a diameter of the channel. ### Claim 12 (depends on 1) The endoscopic device according to claim 1, wherein the processor is configured to: acquire an operation signal related to an instruction to rotate the endoscopic image, acquire the angle information based on the operation signal, update the display endoscopic image based on the angle information and the endoscopic image, update the channel guide image based on the angle information and the channel information, and output the display image including the updated display endoscopic image and the updated channel guide image. ### Claim 13 A display image output method comprising: generating an endoscopic image; acquiring channel information regarding each of at least two channels formed in an insertion portion of an endoscope; acquiring angle information regarding a display angle of the endoscopic image; generating a display endoscopic image by modifying the endoscopic image based on the angle information; generate a channel guide image separate from the endoscopic image based on both the angle information and the channel information; and generating and outputting a display image including both the display endoscopic image and the channel guide image, wherein the channel information includes information regarding angles of positions of channel outlets of respective ones of the two channels or of the channel guide image when the display angle of the endoscopic image is 0°, and/or information regarding angles of positions of the channel outlets or of the channel guide image when the display angle of the endoscopic image is 180°. ### Claim 14 A non-transitory computer-readable storage medium storing a computer executable program for causing a computer to perform processing comprising: generating an endoscopic image; acquiring channel information regarding each of at least two channels formed in an insertion portion of an endoscope; acquiring angle information regarding a display angle of the endoscopic image; generating a display endoscopic image by modifying the endoscopic image based on the angle information; generate a channel guide image separate from the endoscopic image based on both the angle information and the channel information; and generating and outputting a display image including a-both the display endoscopic image and the channel guide image, wherein the channel information includes information regarding angles of positions of channel outlets of respective ones of the two channels or of the channel guide image when the display angle of the endoscopic image is 0°, and/or information regarding angles of positions of the channel outlets or of the channel guide image when the display angle of the endoscopic image is 180°. ### Claim 15 An endoscopic system comprising: an endoscope including: an insertion portion; an image pickup device at a distal-end portion of the insertion portion; at least two channels formed in the insertion portion; and a memory storing channel information regarding the channels, and an endoscopic device including a processor configured to: generate an endoscopic image; acquire channel information regarding each of at least two channels formed in an insertion portion of an endoscope; acquire angle information regarding a display angle of the endoscopic image; generate a display endoscopic image by modifying the endoscopic image based on the angle information; generate a channel guide image separate from the endoscopic image based on both the angle information and the channel information; and generate and output a display image including both the display endoscopic and the channel guide image, wherein the channel information includes information regarding angles of positions of channel outlets of respective ones of the two channels or of the channel guide image when the display angle of the endoscopic image is 0°, and/or information regarding angles of positions of the channel outlets or of the channel guide image when the display angle of the endoscopic image is 180°. ### Claim 16 (depends on 1) The endoscopic device according to claim 1, wherein the channel guide image includes a plurality of guides serving as guides for outlet positions of the channels at a point in time after an instruction for endoscopic-image rotation, and the channel information includes information of diameters of the channel outlets. ### Claim 17 (depends on 13) The endoscopic device according to claim 13, wherein the diameters of the channel outlets are displayed on the channel guide image. ### Claim 18 (depends on 1) The endoscopic device according to claim 1, wherein the channel information includes information regarding the angles of positions of channel outlets of respective ones of the two channels when the display angle of the endoscopic image is 0°, and/or information regarding the angles of positions of the channel outlets when the display angle of the endoscopic image is 180°. ### Claim 19 (depends on 13) The display image output method according to claim 13, wherein the display endoscopic image is generated by rotating the endoscopic image based on the angle information, and the channel guide image includes a guide indicating an outlet position of each of the channels, and a first display angle of the display endoscopic image corresponds to a second display angle of the channel guide image. ### Claim 20 (depends on 15) The endoscopic system according to claim 15, wherein the display endoscopic image is generated by rotating the endoscopic image based on the angle information, and the channel guide image includes a guide indicating an outlet position of each of the channels, and a first display angle of the display endoscopic image corresponds to a second display angle of the channel guide image.