# US 10,769,416 B2 · Image processing method, electronic device and storage medium > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,769,416 B2 - Document ID: US10769416B2 - Status: Granted - Kind: B2 - Application number: 16/183,840 - Filed: 2018-11-08 - Published: 2019-09-19 - Granted: 2020-09-08 - Earliest claimed: 2018-03-18 - Assignees: Guangdong Oppo Mobile Telecommunications Corp., Ltd. - Applicants: Guangdong OPPO Mobile Telecommunications Corp., Ltd. - Inventors: Xinlan He - Web page: https://patentgrep.com/patent/US10769416B2 ## CPC - G06T 5/77: Retouching; Inpainting; Scratch removal - G06V 10/30: Noise filtering - G06V 40/16: Human faces, e.g. facial parts, sketches or expressions - G06V 40/161: {Detection; Localisation; Normalisation} - G06V 40/172: {Classification, e.g. identification} - H04N 23/611: where the recognised objects include parts of the human body - H04N 23/632: {for displaying or modifying preview images prior to image capturing, e.g. variety of image resolutions or capturing parameters} - H04N 23/633: {for displaying additional information relating to control or operation of the camera} - H04N 23/64: {Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image} - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract An image processing method, an electronic device, and a storage medium are described. The image processing method may include acquiring a first face information set output by face recognition operation; acquiring recognition duration of the face recognition operation; determining a preview image at a time point earlier than an output time point by the recognition duration, the output time point being a time point when first face information set is output; and binding the first face information set with the determined preview image. ## Claims ### Claim 1 A method for image processing, comprising: acquiring a first face information set output by face recognition operation; acquiring a recognition duration of the face recognition operation; determining a preview image at a time point earlier than an output time point by the recognition duration, the output time point being a time point when first face information set is output; and binding the first face information set with the determined preview image. ### Claim 2 (depends on 1) The method of claim 1, wherein acquiring the first face information set output by the face recognition operation comprises: acquiring the first face information set output by a face recognition module completing the face recognition operation; and wherein acquiring the recognition duration of the face recognition operation comprises: acquiring the recognition duration for the face recognition module to complete the face recognition operation. ### Claim 3 (depends on 1) The method of claim 1, further comprising: after acquiring the first face information set, binding the first face information set with a preview image at the output time point; and before binding the first face information set with the determined preview image, releasing a binding relationship between the first face information set and the preview image at the output time point. ### Claim 4 (depends on 1) The method of claim 1, further comprising: acquiring sequence information of face information in a second face information set output by a previous face recognition operation; and adjusting a sequence of face information in the first face information set according to the acquired sequence information. ### Claim 5 (depends on 1) The method of claim 1, further comprising: adjusting a sequence of face information in the first face information set according to a predetermined sequence rule for face information. ### Claim 6 (depends on 1) The method of claim 1, further comprising: acquiring an image of a first category and an image of a second category having same image content, wherein the face recognition operation is performed on the image of the second category, and the image of the first category is stored in a preconfigured image buffer queue as a preview image. ### Claim 7 (depends on 6) The method of claim 6, wherein a resolution of the image of the first category is greater than a resolution of the image of the second category. ### Claim 8 (depends on 6) The method of claim 6, wherein determining the preview image at the time point earlier than the output time point by the recognition duration comprises: determining an image of a first category of which a time point when the image of the first category is stored in the preconfigured image buffer queue is earlier than the output time point by the recognition duration; and the determined image of the first category being the determined preview image. ### Claim 9 (depends on 6) The method of claim 6, wherein after binding the first face information set with the determined preview image, the method further comprises: acquiring frame rate information of a camera when receiving an image shooting request; determining a target number corresponding to the frame rate information, and extracting images of the first category of the target number from the preconfigured image buffer queue to obtain a set of the images of the first category; determining an image of the first category to be processed from a set of images of the first category according to face information sets bound with the images of the first category in the set of the images of the first category, wherein the image of the first category to be processed comprises at least one face image meeting a predetermined condition; and performing predetermined processing on the image of the first category to be processed according to other images of the first category in the set of the images of the first category, wherein the image of the first category on which the predetermined processing is completed is a result image in response to the image shooting request. ### Claim 10 (depends on 9) The method of claim 9, wherein performing the predetermined processing on the image of the first category to be processed according to other images of the first category in the set of the images of the first category comprises: determining a face image to be replaced, wherein the face image to be replaced does not meet the predetermined condition in the image of the first category to be processed according to a face information set bound with the image of the first category to be processed; determining a target face image, wherein the target face image meets the predetermined condition from the other images of the first category in the set of the images of the first category, wherein the target face image and the face image to be replaced belong to a same person; and replacing the face image to be replaced with the target face image. ### Claim 11 (depends on 9) The method of claim 9, further comprising: performing noise reduction processing on the image of the first category on which the predetermined processing is completed. ### Claim 12 (depends on 11) The method of claim 11, wherein performing the noise reduction processing on the image of the first category on which the predetermined processing is completed comprises: performing the noise reduction processing on the image of the first category by applying multi-frame noise reduction. ### Claim 13 An electronic device, comprising a processor and a memory storing a computer program executable by the processor to perform: acquiring a first face information set output by face recognition operation; acquiring a recognition duration of the face recognition operation; determining a preview image at a time point earlier than an output time point by the recognition duration, the output time point being a time point when the first face information set is output; and binding the first face information set with the determined preview image. ### Claim 14 (depends on 13) The electronic device of claim 13, further comprising a face recognition module, wherein acquiring the first face information set output by the face recognition operation comprises: acquiring the first face information set output by the face recognition module completing the face recognition operation, wherein acquiring the recognition duration of the face recognition operation comprises: acquiring the recognition duration for the face recognition module to complete the face recognition operation. ### Claim 15 (depends on 13) The electronic device of claim 13, wherein the processor, when executing the computer program, further performs: after acquiring the first face information set, binding the first face information set with a preview image at the output time point; and before binding the first face information set with the determined preview image, releasing a binding relationship between the first face information set and the preview image at the output time point. ### Claim 16 (depends on 13) The electronic device of claim 13, wherein the processor, when executing the computer program, further performs: acquiring sequence information of face information in a second face information set output by a previous face recognition operation; and adjusting a sequence of face information in the first face information set according to the acquired sequence information. ### Claim 17 (depends on 14) The electronic device of claim 14, further comprising an image signal processor, wherein the processor, when executing the computer program, further performs: acquiring an image of a first category and an image of a second category output by the image signal processor and having same image content, wherein the face recognition operation is performed on the image of the second category, and the image of the first category is stored into a preconfigured image buffer queue as a preview image. ### Claim 18 (depends on 17) The electronic device of claim 17, wherein a resolution of the image of the first category is greater than a resolution of the image of the second category. ### Claim 19 (depends on 17) The electronic device of claim 17, wherein determining the preview image at the time point earlier than the output time point by the recognition duration comprises: determining an image of a first category of which a time point when the image of the first category is stored in the preconfigured image buffer queue is earlier than the output time point by the recognition duration, wherein the determined image of the first category is the determined preview image. ### Claim 20 A non-transitory computer-readable storage medium, comprising a computer program executable by a computer to: acquire a first face information set output by face recognition operation; acquire a recognition duration of the face recognition operation; determine a preview image at a time point earlier than an output time point by the recognition duration, the output time point being a time point when the first face information set is output; and bind the first face information set with the determined preview image.