# US 11,908,192 B2 · Electronic device and control method therefor > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 11,908,192 B2 - Document ID: US11908192B2 - Status: Granted - Kind: B2 - Application number: 17/058,913 - Filed: 2019-03-26 - Published: 2021-07-15 - Granted: 2024-02-20 - Earliest claimed: 2018-05-29 - Assignees: Samsung Electronics Co., Ltd. - Applicants: Samsung Electronics Co., Ltd. - Inventors: Donghyun Kim; Juhyoung Lee - Web page: https://patentgrep.com/patent/US11908192B2 ## CPC - G06V 20/46: {Extracting features or characteristics from the video content, e.g. video fingerprints, representative shots or key frames} - G06F 16/75: Clustering; Classification - G06F 16/7837: {using objects detected or recognised in the video content} - G06V 20/41: {Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items (segmenting video sequences G06V20/49)} - G06V 20/47: {Detecting features for summarising video content} - H04N 21/44008: {involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream (arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59)} - H04N 21/4532: {involving end-user characteristics, e.g. viewer profile, preferences (monitoring of user activities for profile generation for accessing a video database G06F16/739; user profiles in network data switching protocols H04L67/306; processing of user preferences or user profiles in wireless networks H04W8/18)} - H04N 21/8549: Creating video summaries, e.g. movie trailer {(retrieval in video databases by using presentations in form of a video summary G06F16/739)} - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract An electronic device is disclosed. The electronic device comprises a memory for storing a content, and a processor for: acquiring a probability value for each of a plurality of objects included in each of a plurality of frames configuring the stored content; grouping the plurality of objects into at least one group according to a correlation value between the plurality of objects, the correlation value being obtained on the basis of the acquired probability value; counting, for each of a plurality of frames for each group, a case where the acquired probability value is equal to or greater than a preconfigured threshold value; and acquiring a summary content on the basis of a result of the counting. ## Claims ### Claim 1 An electronic device comprising: a memory storing a content; and a processor configured to: obtain a probability value of each of a plurality of objects included in each of a plurality of frames configuring the stored content; group the plurality of objects into at least one group in accordance with a correlation value between the plurality of objects based on the obtained probability value; and count cases where the obtained probability value is equal to or greater than a predetermined threshold value for each of the plurality of frames for each group, and obtain a summary content based on the counted result. ### Claim 2 (depends on 1) The device according to claim 1, wherein the processor is configured to: obtain the correlation value between the plurality of objects by comparing a difference of the probability values between the plurality of objects for each of the plurality of frames; and group objects having the obtained correlation value equal to or greater than a predetermined threshold value into one group. ### Claim 3 (depends on 1) The device according to claim 1, wherein the processor is configured to: obtain a main frame for each group based on the counted result and obtain the summary content based on the main frame included in the predetermined group. ### Claim 4 (depends on 3) The device according to claim 3, further comprising: a display, wherein the processor is configured to: identify a representative object among objects belonging to each group; control the display to provide information regarding the identified representative object, and based on information regarding a specific object being selected by a user, provide a summary content obtained based on a main frame of a group of the specific object. ### Claim 5 (depends on 1) The device according to claim 1, wherein the processor is configured to: count the cases where the obtained probability value is equal to or greater than the predetermined threshold value for each of the plurality of frames for each object, and obtain the summary content by identifying objects, the number of times of counting of which for each object is equal to or greater than a predetermined threshold value. ### Claim 6 (depends on 1) The device according to claim 1, wherein the processor is configured to normalize the counted result for each group based on the number of objects belonging to each group. ### Claim 7 (depends on 6) The device according to claim 6, wherein the processor is configured to apply a weight for each group to the normalized value for each group regarding each of the plurality of frames, and obtain the summary content based on a value applied with the weight. ### Claim 8 (depends on 1) The device according to claim 1, wherein the processor is configured to adjust a size of the predetermined threshold value based on a play time of a summary content input in accordance with a user command. ### Claim 9 (depends on 1) The device according to claim 1, wherein the processor is configured to, based on a play time of a summary content input in accordance with a user command being longer than a play time of the obtained summary content, update the summary content by adding frames within a predetermined play time range based on a play point of the summary content. ### Claim 10 A method for controlling an electronic device storing a content, the method comprising: obtaining a probability value of each of a plurality of objects included in each of a plurality of frames configuring the stored content; grouping the plurality of objects into at least one group in accordance with a correlation value between the plurality of objects based on the obtained probability value; counting cases where the obtained probability value is equal to or greater than a predetermined threshold value for each of the plurality of frames for each group; and obtaining a summary content based on the counted result. ### Claim 11 (depends on 10) The method according to claim 10, wherein the obtaining the correlation value comprises obtaining the correlation value between the plurality of objects by comparing a difference of the probability values between the plurality of objects for each of the plurality of frames, and wherein the grouping comprises grouping objects having the obtained correlation value equal to or greater than a predetermined threshold value into one group. ### Claim 12 (depends on 10) The method according to claim 10, wherein the obtaining the summary content comprises obtaining a main frame for each group based on the counted result and obtaining the summary content based on the main frame included in the predetermined group. ### Claim 13 (depends on 12) The method according to claim 12, further comprising: identifying a representative object among objects belonging to each group; and providing information regarding the identified representative object, wherein the obtaining the summary content comprises, based on information regarding a specific object being selected by a user, obtaining a summary content obtained based on a main frame of a group of the specific object. ### Claim 14 (depends on 10) The method according to claim 10, further comprising: counting the cases where the obtained probability value is equal to or greater than the predetermined threshold value for each of the plurality of frames for each object, wherein the obtaining the summary content comprises obtaining the summary content by identifying objects, the number of times of counting of which for each object is equal to or greater than a predetermined threshold value. ### Claim 15 A non-transitory computer readable recording medium storing a computer instruction executable by a processor of an electronic device storing a content to enable the electronic device to perform an operation, wherein the operation comprises: obtaining a plurality of frames from the content; obtaining a probability value of each of a plurality of objects included in each of the plurality of frames configuring the stored content; grouping the plurality of objects into at least one group in accordance with a correlation value between the plurality of objects based on the obtained probability value; counting cases where the obtained probability value is equal to or greater than a predetermined threshold value for each of the plurality of frames for each group; and obtaining a summary content based on the counted result.