# US 11,907,290 B2 · Electronic device and control method thereof > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 11,907,290 B2 - Document ID: US11907290B2 - Status: Granted - Kind: B2 - Application number: 17/984,749 - Filed: 2022-11-10 - Published: 2023-03-02 - Granted: 2024-02-20 - Earliest claimed: 2019-04-03 - Assignees: Samsung Electronics Co., Ltd. - Applicants: Samsung Electronics Co., Ltd. - Inventors: Jiwan Han; Hangyul Kim; Miji Park; Sunyoung Park; Chunhyoung Park; Jiyoung Shin; Younghak Oh - Web page: https://patentgrep.com/patent/US11907290B2 ## CPC - G06F 16/739: {in form of a video summary, e.g. the video summary being a video sequence, a composite still image or having synthesized frames} - G06F 16/7837: {using objects detected or recognised in the video content} - G06F 16/735: Filtering based on additional data, e.g. user or group profiles - G06F 16/7847: {using low-level visual features of the video content} - G11B 27/34: Indicating arrangements {(indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D)} - H04N 1/2145: {of a sequence of images for selection of a single frame before final recording, e.g. from a continuous sequence captured before and after shutter-release} - H04N 1/387: Composing, repositioning or otherwise {geometrically} modifying originals - H04N 1/40: Picture signal circuits (H04N1/387 takes precedence) - H04N 21/234318: {by decomposing into objects, e.g. MPEG-4 objects} - H04N 21/234327: {by decomposing into layers, e.g. base layer and one or more enhancement layers} - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R) - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract An electronic device is provided. The electronic device includes a display, at least one processor, and at least one memory configured to store instructions that cause the at least one processor to obtain first information from a first still image frame that is included in a first moving image, obtain second information from the first moving image, identify at least one image function based on at least one of the first information or the second information, and control the display to display at least one function execution object for executing the at least one image function. Various other embodiments can be provided. ## Claims ### Claim 1 An electronic device comprising: a display; at least one processor; and at least one memory configured to store instructions that cause the at least one processor to: obtain information for a scene recognition result from a still image frame of a moving image, the scene recognition result comprising one of a human recognition result of recognizing a person included in the still image frame, an object recognition result of recognizing a shape included in the still image frame, a place recognition result of recognizing a geographical region included in the still image frame, or a movement recognition result of the human or the object detected in the still image frame, determine, among a plurality of image functions related to the moving image, at least one image function based on the information for the scene recognition result, wherein the plurality of image functions include an image correction function, a text input function, a graphics interchange format (GIF) generation function, an image generation function, and an icon recommendation function, control the display to display at least one function execution object corresponding to the determined at least one image function, and execute, in response to detecting an input for selecting a function execution object of the at least one function execution object, an image function corresponding to the selected function execution object. ### Claim 2 (depends on 1) The electronic device of claim 1, wherein the instructions are further configured to cause the at least one processor to: control the display to playback the moving image, in response to an input for stopping the playback, stop the playback of the moving image at the still image frame and display the still image frame. ### Claim 3 (depends on 2) The electronic device of claim 2, wherein the at least one function execution object includes at least one of an image correction execution object corresponding to the image correction function, a text input execution object corresponding to the text input function, a GIF generation execution object corresponding to the GIF generation function, an image generation execution object corresponding to the image generation function, or an icon recommendation execution object corresponding to the icon recommendation function, wherein, when the information on the human recognition result is obtained, the determined at least one image function includes the image correction function and the image generation function, wherein, when the information on the object recognition result is obtained, the determined at least one image function includes the icon recommendation function, wherein, when the information on the place recognition result is obtained, the determined at least one image function includes the text input function, and wherein, when the information on the movement recognition result is obtained, the determined at least one image function includes the image generation function and the GIF generation function. ### Claim 4 (depends on 3) The electronic device of claim 3, wherein the instructions are further configured to cause the at least one processor to: in response to an input for selecting the image correction execution object, apply an image correction function to the still image frame and generate a corrected image frame, and control the display to display the corrected image frame, and wherein the image correction execution object comprises a portrait correction execution object to correct a face of a person in the still image frame, and wherein the portrait correction execution object including at least one of an intensity correction object, an eye correction object, a face correction object, or a skin tone correction object. ### Claim 5 (depends on 3) The electronic device of claim 3, wherein the instructions are further configured to cause the at least one processor to: in response to an input for selecting the image correction execution object, apply an image correction function to the moving image and generate a second moving image, and control the display to display the second moving image. ### Claim 6 (depends on 3) The electronic device of claim 3, wherein the instructions are further configured to cause the at least one processor to: control the display to display, in response to an input for selecting the text input execution object, a text input box, generate, in response to an input for selecting the GIF generation execution object, a GIF file based on the still image frame, extract, in response to an input for selecting the image generation execution object, a plurality of still image frames from the moving image based on the information, and generate a second moving image based on the plurality of still image frames, and control the display to display, in response to an input for selecting the icon recommendation execution object, one or more selectable icons. ### Claim 7 (depends on 3) The electronic device of claim 3, further comprising a communication circuit, and wherein the instructions are further configured to, in response to an input for selecting the image generation execution object, cause the at least one processor to: control the communication circuit to transmit the still image frame to a server, control the communication circuit to receive one or more still image frames that are selected by the server based on the still image frame, and generate a second moving image based on the one or more still image frames and the still image frame. ### Claim 8 (depends on 3) The electronic device of claim 3, wherein the instructions are further configured to cause the at least one processor to: identify a non-verbal communication in the still image frame, identify a plurality of graphical objects corresponding to the non-verbal communication, display the plurality of graphical objects, and generate, in response to an input onto a first graphical object from the plurality of graphical objects, a second still image frame including the first graphical object. ### Claim 9 (depends on 3) The electronic device of claim 3, wherein the instructions are further configured to cause the at least one processor to: identify that a subject of the still image frame is performing a continuous action, identify a plurality of image frames from the moving image corresponding to the continuous action, and generate a second moving image based on the plurality of image frames and the still image frame. ### Claim 10 (depends on 3) The electronic device of claim 3, wherein the instructions are further configured to cause the at least one processor to: identify a person in the still image frame, identify a plurality of still image frames, in which the identified person is present, from the moving image based on identification of the person, and generate a second moving image based on the plurality of still image frames in which the identified person is present and the still image frame. ### Claim 11 (depends on 1) The electronic device of claim 1, wherein the instructions are further configured to cause the at least one processor to, in response to a user input, control the display to display a shortcut function execution object associated with the function execution object. ### Claim 12 (depends on 1) The electronic device of claim 1, wherein the information further includes at least one of a shooting time of the still image frame, or a comparison result between the still image frame and still image frames preceding or following the still image frame. ### Claim 13 (depends on 9) The electronic device of claim 9, wherein the instructions are further configured to cause the at least one processor to: obtain second information includes at least one of a shooting time, a shooting location, a playback duration, a shooting format, a file name, a resolution, codec information, or a frame rate of the moving image; and determine a quantity of the plurality of image frames based on the second information. ### Claim 14 A method for controlling by an electronic device, the method comprising: obtaining information for a scene recognition result from a still image frame of a moving image, the scene recognition result comprising one of a human recognition result of recognizing a person included in the still image frame, an object recognition result of recognizing a shape included in the still image frame, a place recognition result of recognizing a geographical region included in the still image frame, or a movement recognition result of the human or the object detected in the still image frame; determining, among a plurality of image functions related to the moving image, at least one image function based on the information for the scene recognition result, wherein the plurality of image functions include an image correction function, a text input function, a graphics interchange format (GIF) generation function, an image generation function, and an icon recommendation function; displaying at least one function execution object corresponding to the determined at least one image function; and executing, in response to detecting an input for selecting a function execution object of the at least one function execution object, an image function corresponding to the selected function execution object. ### Claim 15 (depends on 14) The method of claim 14, further comprising: displaying playback of the moving image; and in response to an input for stopping the playback, stopping the playback of the moving image and displaying the still image frame. ### Claim 16 (depends on 15) The method of claim 15, wherein the at least one function execution object includes at least one of an image correction execution object corresponding to the image correction function, a text input execution object corresponding to the text input function, a GIF generation execution object corresponding to the GIF generation function, an image generation execution object corresponding to the image generation function, or an icon recommendation execution object corresponding to the icon recommendation function, wherein, when the information on the human recognition result is obtained, the determined at least one image function includes the image correction function and the image generation function, wherein, when the information on the object recognition result is obtained, the determined at least one image function includes the icon recommendation function, wherein, when the information on the place recognition result is obtained, the determined at least one image function includes the text input function, and wherein, when the information on the movement recognition result is obtained, the determined at least one image function includes the image generation function and the GIF generation function. ### Claim 17 (depends on 16) The method of claim 16, further comprising: in response to an input for selecting the image correction execution object, applying an image correction function to the still image frame and generating a corrected still image frame; and displaying the corrected still image frame. ### Claim 18 (depends on 16) The method of claim 16, further comprising, in response to an input for selecting the text input execution object, displaying a text input box on a display. ### Claim 19 (depends on 16) The method of claim 16, further comprising, in response to an input for selecting the GIF generation execution object, generating a GIF file by using a plurality of still image frames based on the still image frame. ### Claim 20 (depends on 16) The method of claim 16, further comprising: in response to an input for selecting the image generation execution object, extracting a plurality of still image frames from the moving image based on the information; and generating a second moving image.