# US 2018/0027165 A1 · Image processing device, image processing method, program and image processing system > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2018/0027165 A1 - Document ID: US20180027165A1 - Status: Published application - Kind: A1 - Application number: 15/546,111 - Filed: 2015-11-17 - Published: 2018-01-25 - Earliest claimed: 2015-02-12 - Assignees: Sony Corporation - Applicants: Sony Corporation - Inventors: MASASHI MURAKITA - Web page: https://patentgrep.com/patent/US20180027165A1 ## CPC - A61B 1/000095: {for image enhancement} - A61B 1/045: Control thereof - A61B 1/0655: {Control therefor} - G02B 23/24: Instruments {or systems} for viewing the inside of hollow bodies, e.g. fibrescopes - G06T 7/60: Analysis of geometric attributes - H04N 7/183: {for receiving images from a single remote source} - H04N 23/56: provided with illuminating means - H04N 23/71: Circuitry for evaluating the brightness variation - H04N 23/72: Combination of two or more compensation controls - H04N 23/73: by influencing the exposure time - H04N 23/74: by influencing the scene brightness using illuminating means - A61B 1/0669: {at proximal end of an endoscope} - G06T 2207/10024: Color image - G06T 2207/10068: Endoscopic image - H04N 23/12: with one sensor only - H04N 23/555: {for picking-up images in sites, inaccessible due to their dimensions or hazardous conditions, e.g. endoscopes or borescopes} - H04N 23/63: by using electronic viewfinders - A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D) - G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract [Object] It is desirable to provide a technology capable of further appropriately adjusting the luminance of the endoscopic image. [Solution] Provided is an image processing device including: an area extraction unit configured to extract, as an extraction area, an area corresponding to the size of an insertion unit from an endoscopic image based on imaging by an image sensor; and an exposure control unit configured to perform exposure control on a basis of an output value of the image sensor in the extraction area. ## Claims ### Claim 1 An image processing device comprising: an area extraction unit configured to extract, as an extraction area, an area corresponding to the size of an insertion unit from an endoscopic image based on imaging by an image sensor; and an exposure control unit configured to perform exposure control on a basis of an output value of the image sensor in the extraction area. ### Claim 2 (depends on 1) The image processing device according to claim 1, comprising a size acquisition unit configured to acquire the size of the insertion unit. ### Claim 3 (depends on 2) The image processing device according to claim 2, wherein the size acquisition unit acquires the size of the insertion unit from the insertion unit. ### Claim 4 (depends on 2) The image processing device according to claim 2, wherein the size acquisition unit acquires the size of the insertion unit by calculation on a basis of the endoscopic image. ### Claim 5 (depends on 4) The image processing device according to claim 4, wherein the size acquisition unit calculates the size of the insertion unit on a basis of a first pixel position at which a magnitude relation between a luminance and a threshold is first switched, in a case of scanning from a first start position toward a first target position of the endoscopic image in a first scanning direction. ### Claim 6 (depends on 5) The image processing device according to claim 5, wherein the first start position is a center position of the endoscopic image, and the first target position is an end position of the endoscopic image. ### Claim 7 (depends on 5) The image processing device according to claim 5, wherein the first start position is an end position of the endoscopic image, and the first target position is a center position of the endoscopic image. ### Claim 8 (depends on 6) The image processing device according to claim 6, wherein the size acquisition unit calculates, as the size of the insertion unit, a first distance between the first pixel position and the center position or twice the first distance. ### Claim 9 (depends on 5) The image processing device according to claim 5, wherein the first scanning direction is an upward direction, a downward direction, a left direction, a right direction or an oblique direction. ### Claim 10 (depends on 6) The image processing device according to claim 6, wherein the size acquisition unit calculates the size of the insertion unit on a basis of a second pixel position at which a magnitude relation between a luminance and a threshold is first switched and the first pixel position in a case of scanning from a second start position of the endoscopic image in a second scanning direction. ### Claim 11 (depends on 10) The image processing device according to claim 10, wherein in a case that a difference between a first distance between the first pixel position and the center position and a second distance between the second pixel position and the center position is less than a predetermined distance, the size acquisition unit calculates, as the size of the insertion unit, a sum of the first distance and the second distance. ### Claim 12 (depends on 10) The image processing device according to claim 10, wherein in a case that a difference between a first distance between the first pixel position and the center position and a second distance between the second pixel position and the center position is greater than a predetermined distance, the size acquisition unit calculates, as the size of the insertion unit, twice the larger one of the first distance and the second distance. ### Claim 13 (depends on 5) The image processing device according to claim 5, wherein the size acquisition unit sets the threshold on a basis of a number-of-pixel distribution for each luminance of the endoscopic image. ### Claim 14 (depends on 1) The image processing device according to claim 1, wherein the exposure control unit adjusts a parameter for controlling exposure on a basis of an output value of the image sensor in the extraction area. ### Claim 15 (depends on 14) The image processing device according to claim 14, wherein the parameter includes at least any one of an electronic shutter speed of the image sensor and a gain by which an analog signal captured by the image sensor is multiplied. ### Claim 16 (depends on 14) The image processing device according to any one of claim 14, wherein the parameter includes brightness of a light source. ### Claim 17 (depends on 1) The image processing device according to claim 1, wherein the exposure control unit performs the exposure control based on an output value of the image sensor in the extraction area in a case of having determined that a shadow of the insertion unit is imaged in the endoscopic image. ### Claim 18 An image processing device comprising: extracting, as an extraction area, an area corresponding to the size of an insertion unit from an endoscopic image based on imaging by an image sensor; and performing exposure control by a processor on a basis of an output value of the image sensor in the extraction area. ### Claim 19 A program for causing a computer to function as an image processing device comprising: an area extraction unit configured to extract, as an extraction area, an area corresponding to the size of an insertion unit from an endoscopic image based on imaging by an image sensor; and an exposure control unit configured to perform exposure control on a basis of an output value of the image sensor in the extraction area. ### Claim 20 An image processing system comprising: a light source unit configured to emit light; an image sensor configured to capture an endoscopic image by receiving reflected light of the light emitted by the light source unit; and an image processing device including an area extraction unit configured to extract, as an extraction area, an area corresponding to the size of an insertion unit from the endoscopic image, and an exposure control unit configured to perform exposure control on a basis of an output value of the image sensor in the extraction area.