# US 10,771,674 B2 · Image processing device, method of processing image, image processing program, and imaging device > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,771,674 B2 - Document ID: US10771674B2 - Status: Granted - Kind: B2 - Application number: 16/557,240 - Filed: 2019-08-30 - Published: 2019-12-19 - Granted: 2020-09-08 - Earliest claimed: 2013-07-23 - Assignees: Sony Corporation - Applicants: Sony Corporation - Inventors: Toshiki Ono; Ryuji Shibata - Web page: https://patentgrep.com/patent/US10771674B2 ## CPC - H04N 23/675: {comprising setting of focusing regions} - G06T 5/73: Deblurring; Sharpening - G06V 40/161: {Detection; Localisation; Normalisation} - H04N 23/61: based on recognised objects - H04N 23/611: where the recognised objects include parts of the human body - H04N 23/62: Control of parameters via user interfaces - H04N 23/632: {for displaying or modifying preview images prior to image capturing, e.g. variety of image resolutions or capturing parameters} - H04N 23/633: {for displaying additional information relating to control or operation of the camera} - H04N 23/672: {based on the phase difference signals} - H04N 23/673: {based on contrast or high frequency components of image signals, e.g. hill climbing method} - H04N 23/959: by adjusting depth of field during image capture, e.g. maximising or setting range based on scene characteristics - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING ## Abstract An information processing system configured to perform predetermined processing based on out-of-focus information corresponding to a first area of an image, the out-of-focus information corresponding to a difference in focus between the first area of the image and a second area of the image that is different from the first area of the image. ## Claims ### Claim 1 An information processing system comprising: circuitry configured to perform predetermined processing based on out-of-focus information corresponding to a first area of an image, the out-of-focus information corresponding to a difference in focus between the first area of the image and a second area of the image that is different from the first area of the image, wherein the predetermined processing includes controlling a display to display an enlarged version of the image including the first area and the second area. ### Claim 2 (depends on 1) The information processing system of claim 1, wherein the circuitry is configured to identify the first area of the image, and acquire the out-of-focus information corresponding to the first area of the image. ### Claim 3 (depends on 2) The information processing system of claim 2, wherein the second area of the image is an in-focus area of the image. ### Claim 4 (depends on 3) The information processing system of claim 3, wherein the predetermined processing includes outputting a notification corresponding to the out-of-focus information. ### Claim 5 (depends on 1) The information processing system of claim 1, wherein an enlargement range of the enlarged version of the image is set so that a first display area corresponding to the first area and a second display area corresponding to the second area are substantially similar. ### Claim 6 (depends on 1) The information processing system of claim 1, wherein the circuitry is configured to control the display to display the image and the enlarged version of the image simultaneously. ### Claim 7 (depends on 1) The information processing system of claim 1, wherein the circuitry is configured to control the display to display the enlarged version of the image superimposed on the image. ### Claim 8 (depends on 1) The information processing system of claim 1, wherein the predetermined processing includes controlling a display to display the image while applying a graphical effect to the first area of the image. ### Claim 9 (depends on 1) The information processing system of claim 1, wherein the predetermined processing includes trimming the image based on the out-of-focus information. ### Claim 10 (depends on 9) The information processing system of claim 9, wherein the circuitry is configured to control a display to display the image that is trimmed. ### Claim 11 (depends on 1) The information processing system of claim 1, wherein the predetermined processing includes generating a first trimmed version of the image and a second trimmed version of the image based on the out-of-focus information. ### Claim 12 (depends on 11) The information processing system of claim 11, wherein the circuitry is configured to control a display to display the first trimmed version of the image and the second trimmed version of the image. ### Claim 13 An information processing system comprising: circuitry configured to perform predetermined processing based on out-of-focus information corresponding to a first area of an image, the out-of-focus information corresponding to a difference in focus between the first area of the image and a second area of the image that is different from the first area of the image, determine a composition included in the image, determine a recommended blur amount based on the composition included in the image, determine a blur prediction amount of the first area, determine whether a difference between the recommended blur amount and the blur prediction amount is within a predetermined range, and responsive to determining that the difference between the recommended blur amount and the blur prediction amount is not within the predetermined range, superimpose a mask on the image to generate a through image with the recommended blur amount. ### Claim 14 An information processing system comprising: circuitry configured to perform predetermined processing based on out-of-focus information corresponding to a first area of an image, the out-of-focus information corresponding to a difference in focus between the first area of the image and a second area of the image that is different from the first area of the image, determine a composition included in the image, determine a recommended blur amount based on the composition included in the image, determine a blur prediction amount of the image, generate a histogram indicating the recommended blur amount and the blur prediction amount, and superimpose the histogram on the image to generate a through image with the histogram. ### Claim 15 An information processing system comprising: circuitry configured to perform predetermined processing based on out-of-focus information corresponding to a first area of an image, the out-of-focus information corresponding to a difference in focus between the first area of the image and a second area of the image that is different from the first area of the image, determine a recommended composition for the image, determine a recommended blur amount based on the recommended composition, determine a blur prediction amount of the image, generate a graph indicating the recommended blur amount and the blur prediction amount, and superimpose the graph on the image to generate a through image with the graph. ### Claim 16 An information processing system comprising: circuitry configured to perform predetermined processing based on out-of-focus information corresponding to a first area of an image, the out-of-focus information corresponding to a difference in focus between the first area of the image and a second area of the image that is different from the first area of the image, determine a plurality of segmentation range candidates, determine a recommended blur amount for each of the plurality of segmentation range candidates, determine a blur prediction amount for each of the plurality of segmentation range candidates, determine one or more segmentation ranges from the plurality of segmentation range candidates based on a composition where the blur prediction amount is closest to the recommended blur amount, a position where the blur prediction amount in the one or more segmentation ranges is closest to the recommended blur amount, and a position where a degree of separation between respective blur prediction amounts is highest, and trim the image based on the one or more segmentation ranges to generate one or more through images. ### Claim 17 An information processing method comprising: performing, with circuitry, predetermined processing based on out-of-focus information corresponding to a first area of an image, the out-of-focus information corresponding to a difference in focus between the first area of the image and a second area of the image that is different from the first area of the image, wherein the predetermined processing includes controlling a display to display an enlarged version of the image including the first area and the second area. ### Claim 18 A non-transitory computer-readable medium including computer-program instructions that, when executed by a system, cause the system to perform a set of operations comprising: performing predetermined processing based on out-of-focus information corresponding to a first area of an image, the out-of-focus information corresponding to a difference in focus between the first area of the image and a second area of the image that is different from the first area of the image, wherein the predetermined processing includes controlling a display to display an enlarged version of the image including the first area and the second area. ### Claim 19 (depends on 18) The non-transitory computer-readable medium of claim 18, wherein an enlargement range of the enlarged version of the image is set so that a first display area corresponding to the first area and a second display area corresponding to the second area are substantially similar. ### Claim 20 (depends on 17) The information processing method of claim 17, wherein an enlargement range of the enlarged version of the image is set so that a first display area corresponding to the first area and a second display area corresponding to the second area are substantially similar.