# US 10,504,560 B2 · Electronic device and operation method thereof > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,504,560 B2 - Document ID: US10504560B2 - Status: Granted - Kind: B2 - Application number: 15/648,766 - Filed: 2017-07-13 - Published: 2018-02-01 - Granted: 2019-12-10 - Earliest claimed: 2016-08-01 - Assignees: Samsung Electronics Co., Ltd. - Applicants: Samsung Electronics Co., Ltd. - Inventors: Seoyoung Lee; Bado Lee; Yumin Jung; Daehee Kim; Dae-Kyu Shin; Sung Dae Cho; Ji-Yoon Park - Web page: https://patentgrep.com/patent/US10504560B2 ## CPC - G11B 27/3081: {used signal is a video-frame or a video-field (P.I.P)} - G06V 20/30: in albums, collections or shared content, e.g. social network photos or video - G06V 20/41: {Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items (segmenting video sequences G06V20/49)} - G06V 20/47: {Detecting features for summarising video content} - G11B 27/031: Electronic editing of digitised analogue information signals, e.g. audio or video signals - G11B 27/28: by using information signals recorded by the same method as the main recording {(G11B27/22 takes precedence)} - G11B 27/34: Indicating arrangements {(indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D)} - H04N 5/772: {the recording apparatus and the television camera being placed in the same enclosure} - H04N 5/93: Regeneration of the television signal or of selected parts thereof - H04N 23/62: Control of parameters via user interfaces - H04N 23/63: by using electronic viewfinders - G06V 40/161: {Detection; Localisation; Normalisation} - G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R) - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract The present disclosure relates to an electronic device and a method of operation thereof, and the electronic device includes: a display; and a processor electrically connected with the display, and the processor is configured to extract a plurality of frames from video data, to identify a size of an object included in each of the extracted frames and a number of objects, to determine a layout regarding each of the extracted frames based on the size of the object and the number of objects, and to display the extracted frames on the display to correspond to the layout. ## Claims ### Claim 1 An electronic device comprising: a display; and a processor connected with the display, the processor configured to: extract a plurality of frames from video data, identify, based on a face recognition function, first objects in each of the extracted frames, select a set of frames from the extracted frames based on at least one of sizes of the first objects identified in each of the extracted frames or a number of the objects identified in each of the extracted frames, determine a layout for displaying the extracted frames based on the set of frames, and display the extracted frames on the display according to the determined layout, wherein the processor is further configured to: if a number of the frames included in the set of frames is less than a reference frame number, identify, based on a recognition function, second objects in each of the extracted frames, select an additional set of frames from the extracted frames based on at least one of sizes of the second objects identified in each of the extracted frames or a number of the second objects identified in each of the extracted frames, and update the set of frames by adding the additional set of frames. ### Claim 2 (depends on 1) The electronic device of claim 1, wherein the layout comprises at least one of: a size of a frame and a display location of a frame. ### Claim 3 (depends on 1) The electronic device of claim 1, wherein the processor is configured to, display the set of the frames comprising frames of which the number of at least one of the first objects or the second objects is within a predetermined number range to a first layout, and display at least one other frame from among the extracted frames to a second layout, wherein the first layout comprises a layout for highlighting frames to be distinguished from frames of the second layout. ### Claim 4 (depends on 1) The electronic device of claim 1, wherein the processor is configured to, display the set of the frames comprising frames of which the sizes of at least one of the first objects or the second objects is within a predetermined size range to a first layout, and display at least one other frame from among the extracted frames to a second layout, wherein the first layout comprises a layout for highlighting frames to be distinguished from frames of the second layout. ### Claim 5 (depends on 1) The electronic device of claim 1, wherein the processor is configured to, display at least one frame related to a first specified photographing mode from among the set of the frames to a first layout, and display at least one other frame related to a second specified photographing mode from among the set of the frames to a second layout, wherein the first layout comprises a layout for highlighting frames to be distinguished from frames of the second layout. ### Claim 6 (depends on 1) The electronic device of claim 1, wherein the processor is configured to, display at least one frame comprising audio information satisfying a first condition from among the set of the frames to a first layout, and display at least one other frame comprising audio information satisfying a second condition from among the set of the frames to a second layout, wherein the first layout comprises a layout for highlighting frames to be distinguished from frames of the second layout, and wherein the audio information satisfying the condition comprises at least one of: a change in an emotion and a change in a speaker. ### Claim 7 (depends on 1) The electronic device of claim 1, wherein the processor is configured to, display a frame having a time interval greater than or equal to a reference time from among the set of the frames to a first layout, and display a frame having a time interval less the reference time from among the set of the frames to a second layout, wherein the first layout comprises a layout for highlighting frames to be distinguished from frames of the second layout. ### Claim 8 (depends on 1) The electronic device of claim 1, wherein the processor is configured to display the extracted frames based on a time sequence of the frames. ### Claim 9 (depends on 1) The electronic device of claim 1, wherein, in response to at least one frame being selected from among the extracted frames displayed on the display, the processor is configured to determine a time to reproduce the video data based on the selected frame. ### Claim 10 (depends on 1) The electronic device of claim 1, wherein the layout comprises at least one of: a size of a frame and a display location of a frame. ### Claim 11 A method of operating an electronic device, the method comprising: extracting a plurality of frames from video data; identifying, based on a face recognition function, at least one first objects in each of the extracted frames; selecting a set of frames from the extracted frames based on at least one of sizes of the first objects identified in each of the extracted frames or a number of the objects identified in each of the extracted frames; determining a layout for displaying the extracted frames based on the set of frames; displaying the extracted frames according to the determined layout, if a number of the frame included in the set of frames is less than a reference frame number, identifying, based on a recognition function, second objects in each of the extracted frames, selecting an additional set of frames from the extracted frames based on at least one of sizes of the second objects identified in each of the extracted frames or a number of the second objects identified in each of the extracted frames, updating the set of frames by adding the additional set of frames. ### Claim 12 (depends on 11) The method of claim 11, wherein determining the layout comprises determining at least one of: a size of a frame and a display location of a frame. ### Claim 13 (depends on 11) The method of claim 11, wherein determining the layout comprises determining the set of the frames comprising frames of which the number of at least one of the first objects or the second objects is within a predetermined number range as a first layout, and determining at least one other frame from among the extracted frames as a second layout, wherein the first layout comprises a layout for highlighting frames to be distinguished from frames of the second layout. ### Claim 14 (depends on 11) The method of claim 11, wherein determining the layout comprises determining the set of the frames comprising frames of which the size of at least one of the first objects or the second objects is within a predetermined size range as a first layout, and determining at least one other frame from among the extracted frames as a second layout, wherein the first layout comprises a layout for highlighting frames to be distinguished from frames of the second layout. ### Claim 15 (depends on 11) The method of claim 11, wherein determining the layout comprises determining at least one frame related to a first specified photographing mode from among the set of the frames as a first layout, and determining at least one other frame related to a second specified photographing mode from among the set of the frames as a second layout, wherein the first layout comprises a layout for highlighting frames to be distinguished from frames of the second layout. ### Claim 16 (depends on 11) The method of claim 11, wherein determining the layout comprises determining at least one frame comprising audio information satisfying a first condition from among the set of the frames as a first layout, and determining at least one other frame comprising audio information satisfying a second condition from among the set of the frames as a second layout, wherein the first layout comprises a layout for highlighting frames to be distinguished from frames of the second layout, and wherein the audio information satisfying the condition comprises at least one of: a change in an emotion and a change in a speaker. ### Claim 17 (depends on 11) The method of claim 11, wherein determining the layout comprises determining a frame having a time interval greater than or equal to a reference time from among the set of the frames as a first layout, and determining a frame having a time interval less the reference time from among the set of the frames as a second layout, wherein the first layout comprises a layout for highlighting frames to be distinguished from frames of the second layout. ### Claim 18 (depends on 11) The method of claim 11, wherein displaying the extracted frames to correspond to the layout comprises displaying the extracted frames based on a time sequence of the frames. ### Claim 19 (depends on 11) The method of claim 11, further comprising, in response to at least one frame being selected from among the extracted frames displayed on a display of the electronic device, determining a time to reproduce the video data based on the selected frame. ### Claim 20 (depends on 11) The method of claim 11, wherein determining the layout comprises determining at least one of: a size of a frame and a display location of a frame.