# US 11,443,434 B2 · Image processing apparatus and non-transitory computer readable medium storing program > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 11,443,434 B2 - Document ID: US11443434B2 - Status: Granted - Kind: B2 - Application number: 16/892,307 - Filed: 2020-06-04 - Published: 2021-04-08 - Granted: 2022-09-13 - Earliest claimed: 2019-10-03 - Assignees: FUJIFILM Business Innovation Corp. - Applicants: FUJIFILM Business Innovation Corp. - Inventors: Aoi Kamo - Web page: https://patentgrep.com/patent/US11443434B2 ## CPC - G06T 7/11: Region-based segmentation - G06F 18/22: Matching criteria, e.g. proximity measures - G06T 3/04: Context-preserving transformations, e.g. by using an importance map (panospheric to cylindrical image transformations G06T3/12) - G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80) - G06V 10/25: Determination of region of interest [ROI] or a volume of interest [VOI] - G06V 10/44: Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components - G06V 10/75: Organisation of the matching processes, e.g. simultaneous or sequential comparisons of image or video features; Coarse-fine approaches, e.g. multi-scale approaches; using context analysis; Selection of dictionaries - G06T 2207/20132: Image cropping - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING ## Abstract An image processing apparatus includes an input unit that inputs an image, and a processor configured to read out a program stored in a memory, and executes the program. The processor is configured to detect an intended subject from the input image by a first detection method, set an intended subject region for the detected intended subject, detect the intended subject from the input image by a second detection method different from the first detection method, and update the set intended subject region by using a detection result of the second detection method. ## Claims ### Claim 1 An image processing apparatus comprising: an input unit that inputs an image; and a hardware processor configured to read out a program stored in a memory, and executes the program, wherein the hardware processor is configured to detect an intended subject from the input image by a first detection method, set an intended subject region for the detected intended subject, detect the intended subject from the input image by a second detection method different from the first detection method, and update the set intended subject region by using a detection result of the second detection method, wherein the hardware processor is configured to detect a salient region from the input image, as the second detection method, and update the set intended subject region by expanding the set intended subject region by using the salient region, wherein the hardware processor is configured to limit an expansion range of the intended subject region by the detection result, and decide an upper limit of the expansion, and wherein the hardware processor is configured to expand the intended subject region by adding pixels which are adjacent to the intended subject region and are detected in the detection result to pixels of the intended subject region. ### Claim 2 (depends on 1) The image processing apparatus according to claim 1, wherein the hardware processor is configured to binarize the input image, as the second detection method. ### Claim 3 (depends on 2) The image processing apparatus according to claim 2, wherein the hardware processor is configured to update the set intended subject region by expanding the set intended subject region by using a binarization result. ### Claim 4 (depends on 1) The image processing apparatus according to claim 1, wherein the hardware processor is configured to detect a salient region indicating a degree of attention of a person from the input image and binarize the input image, as the second detection method. ### Claim 5 (depends on 4) The image processing apparatus according to claim 4, wherein the hardware processor is configured to update the set intended subject region by using the salient region and a binarization result. ### Claim 6 (depends on 5) The image processing apparatus according to claim 5, wherein the hardware processor is configured to update the set intended subject region by expanding the set intended subject region by using the salient region and further calculating a logical sum of a binarization region of the binarization result and the set intended subject region. ### Claim 7 (depends on 1) The image processing apparatus according to claim 1, wherein the hardware processor is configured to further set an unnecessary subject region from the input image by using the detection result of the second detection method and the updated intended subject region. ### Claim 8 (depends on 7) The image processing apparatus according to claim 7, wherein the hardware processor is configured to further update the updated intended subject region by using the unnecessary subject region. ### Claim 9 (depends on 1) The image processing apparatus according to claim 1, wherein the hardware processor is configured to further set a cutout region from the updated intended subject region, and cut out the intended subject from the input image by using the cutout region.