# US 10,765,295 B2 · Image processing apparatus for detecting motion between two generated motion detection images based on images captured at different times, method for operating such image processing apparatus, computer-readable recording medium, and endoscope device > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,765,295 B2 - Document ID: US10765295B2 - Status: Granted - Kind: B2 - Application number: 15/639,526 - Filed: 2017-06-30 - Published: 2017-10-19 - Granted: 2020-09-08 - Earliest claimed: 2015-01-20 - Assignees: Olympus Corporation - Applicants: Olympus Corporation - Inventors: Jumpei Takahashi - Web page: https://patentgrep.com/patent/US10765295B2 ## CPC - H04N 25/134: {based on three different wavelength filter elements} - A61B 1/00009: {of image signals during a use of endoscope} - A61B 1/000095: {for image enhancement} - A61B 1/04: combined with photographic or television appliances - A61B 1/0638: {providing two or more wavelengths} - A61B 1/0646: {with illumination filters} - H04N 23/10: for generating image signals from different wavelengths - H04N 23/56: provided with illuminating means - H04N 23/95: Computational photography systems, e.g. light-field imaging systems - H04N 23/555: {for picking-up images in sites, inaccessible due to their dimensions or hazardous conditions, e.g. endoscopes or borescopes} - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D) ## Abstract An image processing apparatus configured to perform averaging processing on pixel values of pixels having different color filters to obtain a signal value, and generate motion detection images based on the signal value in such a way that, in WLI, a weight of a pixel value for a filter for passing light of a luminance component of a captured image in WLI is set to be larger than or equal to a weight of a pixel value for a different filter while in NBI, a weight of a pixel value for a filter for passing light of a luminance component of a captured image in NBI is set to be larger than or equal to a weight of a pixel value for a different filter. Based on the captured images at different points in time, the image processing apparatus detects motion between two of the generated motion detection images. ## Claims ### Claim 1 An image processing apparatus for generating a captured image based on a signal value generated by a plurality of pixels according to one of white illumination light in white light imaging and narrow band illumination light in a narrow band light imaging, the white illumination light including red, green, and blue wavelength bands, the narrow band illumination light being included in one of the red, green, and blue wavelength bands, the image processing apparatus comprising: a processor configured to: perform averaging processing on pixel values of pixels included in a group of a plurality of pixels having different color filters to obtain a signal value for generating motion detection images, and generate the motion detection images for detecting motion between captured images at different points in time based on the signal value obtained by the averaging processing in such a way that, in the white light imaging, a weight of a pixel value of a pixel having a filter for passing light of a luminance component of a captured image in the white light imaging is set to be larger than or equal to a weight of a pixel value of a pixel having a different type of filter while in the narrow band imaging, a weight of a pixel value of a pixel having a filter for passing light of a luminance component of a captured image in the narrow band imaging is set to be larger than or equal to a weight of a pixel value of a pixel having a different type of filter; and detect, based on the generated motion detection images, the motion between two of the motion detection images generated based on the captured images at the different points in time. ### Claim 2 (depends on 1) The image processing apparatus according to claim 1, wherein the luminance component in the white light imaging is a green component, the luminance component in the narrow band light imaging is a blue component, and the processor is configured to perform the averaging processing by weighting the pixel value of the green component in the white light imaging, and perform the averaging processing by weighting the pixel value of the blue component in the narrow band light imaging. ### Claim 3 (depends on 1) The image processing apparatus according to claim 1, wherein phases of the signal value for generating the motion detection images based on an arrangement in the group of the plurality of pixels, are uniformly arranged in the motion detection images. ### Claim 4 (depends on 1) The image processing apparatus according to claim 1, wherein the processor is further configured to reduce a noise component included in the captured images based on the detected motion. ### Claim 5 A method for operating an image processing apparatus for generating a captured image based on a signal value generated by a plurality of pixels according to one of white illumination light in white light imaging and narrow band illumination light in a narrow band light imaging, the white illumination light including red, green, and blue wavelength bands, the narrow band illumination light being included in one of the red, green, and blue wavelength bands, the method comprising: averaging processing on pixel values of pixels included in a group of a plurality of pixels having different color filters to obtain a signal value for generating motion detection images, and generating the motion detection images for detecting motion between captured images at different points in time based on the signal value obtained by the averaging processing in such a way that, in the white light imaging, a weight of a pixel value of a pixel having a filter for passing light of a luminance component of a captured image in the white light imaging is set to be larger than or equal to a weight of a pixel value of a pixel having a different type of filter while in the narrow band imaging, a weight of a pixel value of a pixel having a filter for passing light of a luminance component of a captured image in the narrow band imaging is set to be larger than or equal to a weight of a pixel value of a pixel having a different type of filter; and detecting, based on the generated motion detection images, the motion between two of the motion detection images generated based on the captured images at the different points in time. ### Claim 6 A non-transitory computer-readable recording medium with an executable program stored thereon for operating an image processing apparatus for generating a captured image based on a signal value generated by a plurality of pixels according to one of white illumination light in white light imaging and narrow band illumination light in a narrow band light imaging, the white illumination light including red, green, and blue wavelength bands, the narrow band illumination light being included in one of the red, green, and blue wavelength bands, the program causing the image processing apparatus to execute: performing averaging processing on pixel values of pixels included in a group of a plurality of pixels having different color filters to obtain a signal value for generating motion detection images, and generating the motion detection images for detecting motion between captured images at different points in time based on the signal value obtained by the averaging processing in such a way that, in the white light imaging, a weight of a pixel value of a pixel having a filter for passing light of a luminance component of a captured image in the white light imaging is set to be larger than or equal to a weight of a pixel value of a pixel having a different type of filter while in the narrow band imaging, a weight of a pixel value of a pixel having a filter for passing light of a luminance component of a captured image in the narrow band imaging is set to be larger than or equal to a weight of a pixel value of a pixel having a different type of filter; and detecting, based on the generated motion detection images, the motion between two of the motion detection images generated based on the captured images at the different points in time. ### Claim 7 (depends on 1) An endoscope device for performing white light imaging and narrow band light imaging, the endoscope device comprising: a light source configured to emit one of white illumination light and narrow band illumination light, the white illumination light including red, green, and blue wavelength bands, the narrow band illumination light including two narrow bands included in one of wavelength bands of luminance components in the white light imaging and the narrow band light imaging; an image sensor having a plurality of pixels arranged in a matrix form, the plurality of pixels being configured to receive light and perform photoelectric conversion on the received light to generate an electric signal; a color filter having a plurality of filter units arranged on a light-receiving surface of the image sensor, each of the plurality of filter units including a first filter, a second filter, and a third filter, the first filter being configured to pass light of wavelength bands of a luminance component in the white light imaging and a luminance component in the narrow band light imaging, the second filter being configured to pass light of a wavelength band of the luminance component in the white light imaging, and the third filter being configured to pass light of a wavelength band of the luminance component in the narrow band light imaging; and the image processing apparatus according to claim 1.