# US 10,313,712 B2 · Method, device, and server for producing video frame set > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,313,712 B2 - Document ID: US10313712B2 - Status: Granted - Kind: B2 - Application number: 15/522,546 - Filed: 2015-08-10 - Published: 2017-11-02 - Granted: 2019-06-04 - Earliest claimed: 2014-10-31 - Assignees: Guangzhou Ucweb Computer Technology Co., Ltd. - Applicants: Guangzhou Ucweb Computer Technology Co., Ltd. - Inventors: Jie Liang - Web page: https://patentgrep.com/patent/US10313712B2 ## CPC - H04N 21/23418: {involving operations for analysing video streams, e.g. detecting features or characteristics (television picture signal circuitry for scene change detection H04N5/147; filtering for image enhancement G06T5/00; methods or arrangements for recognising scenes G06V20/00; arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59)} - H04N 21/23424: {involving splicing one content stream with another content stream, e.g. for inserting or substituting an advertisement} - H04N 21/2387: Stream processing in response to a playback request from an end-user, e.g. for trick-play - H04N 21/2402: {Monitoring of the downstream path of the transmission network, e.g. bandwidth available (traffic monitoring in data switching networks H04L43/00; monitoring data switching networks utilization H04L43/0876)} - H04N 21/2407: {Monitoring of transmitted content, e.g. distribution time, number of downloads (arrangements for monitoring programmes for broadcast or for distribution combined with broadcast H04H20/14)} - H04N 21/4343: {Extraction or processing of packetized elementary streams [PES]} - H04N 21/44: Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs - H04N 21/8549: Creating video summaries, e.g. movie trailer {(retrieval in video databases by using presentations in form of a video summary G06F16/739)} - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract Disclosed are a method, device, and server for producing a video frame set. The method comprises: compiling statistics on the degree of playback intensity of each video frame in a video, selecting at least one “selected video frame” from the video on a basis of the degree of playback intensity, where the degree of playback intensity of the video frame is a ratio between the number of times that the video frame is played back and the number of times the video is played back; and then, splicing the “selected video frames” to form a video frame set. The present embodiment selects the “selected video frames” on a basis of the degree of playback intensity of the video frames in the video, and splices together the video frames so selected to form a video frame set, thus allowing video contents considered to be highlights by a majority of users to be spliced into the video frame set. ## Claims ### Claim 1 A method for producing a video frame set, comprising: compiling statistics on a degree of playback intensity of each video frame in a video; selecting at least one intensively played-back video frame from the video on the basis of the degree of playback intensity, wherein the degree of playback intensity of the video frame is a ratio between the number of times that the video frame is played back and the number of times the video is played back, wherein selecting the at least one intensively played-back video frame from the video on the basis of the degree of playback intensity comprises: screening out video frames which have degrees of playback intensity greater than a predetermined threshold, wherein among the screened-out video frames, if multiple video frames are consecutive, the multiple video frames are considered as an intensively played-back video segment, and if a video frame is not consecutive with any other video frames, the video frame is considered as a separated video segment; and extracting at least one video frame from at least one intensively played-back video segment or separated video segment as selected video frames; and splicing the selected video frames to form the video frame set. ### Claim 2 (depends on 1) The method according to claim 1, wherein the step of selecting the at least one intensively played-back video frame from the video further comprises: determining the number of selected video frames extracted from each intensively played-back video segment. ### Claim 3 (depends on 2) The method according to claim 2, wherein the step of determining the number of selected video frames extracted from each intensively played-back video segment comprises: calculating an average degree of playback intensity of all video frames in each intensively played-back video segment; calculating a proportion of video frames, of which the degrees of playback intensity are greater than or equal to the average degree of playback intensity, in each intensively played-back video segment; and determining, according to the proportion, the number of selected video frames extracted from each intensively played-back video segment. ### Claim 4 (depends on 3) The method according to claim 3, wherein the step of determining, according to the proportion, the number of selected video frames extracted from each intensively played-back video segment comprises: gradually reducing, according to the proportion from large to small, the number of selected video frames extracted from each intensively played-back video segment. ### Claim 5 (depends on 2) The method according to claim 2, wherein the step of determining the number of selected video frames extracted from each intensively played-back video segment comprises: determining the length of each intensively played-back video segment; and determining, according to the length of each intensively played-back video segment, the number of selected video frames extracted from each intensively played-back video segment. ### Claim 6 (depends on 5) The method according to claim 5, wherein the step of determining, according to the length of each intensively played-back video segment, the number of selected video frames extracted from each intensively played-back video segment comprises: gradually reducing, according to the length of each intensively played-back video segment from long to short, the number of selected video frames extracted from each intensively played-back video segment. ### Claim 7 (depends on 4) The method according to claim 4, further comprising: when the number of actual video frames in each intensively played-back video segment is less than the number of the extracted selected video frames, extracting all video frames in the intensively played-back video segment, and using all the video frames as the number of the extracted selected video frames; and when the number of actual video frames in each intensively played-back video segment is greater than or equal to the number of the extracted selected video frames, randomly extracting consecutive frames in each intensively played-back video segment, and using the consecutive frames as the number of the extracted selected video frames. ### Claim 8 (depends on 2) The method according to claim 2, wherein the step of splicing the selected video frames to form the video frame set comprises: arranging the extracted selected video frames gradually according to the number thereof from more to less; wherein the selected video frames in a same intensively played-back video segment are arranged according to a playback time sequence thereof in the video. ### Claim 9 (depends on 1) The method according to claim 1, wherein the step of extracting a selected video frame from the at least one intensively played-back video segment comprises: extracting a predetermined number of video frames from each intensively played-back video segment; or extracting all video frames from each intensively played-back video segment. ### Claim 10 (depends on 1) The method according to claim 1, wherein the step of extracting a selected video frame from the at least one intensively played-back video segment comprises: extracting selected video frame randomly from each intensively played-back video segment; or extracting several video frames before a video frame having the maximum degree of intensity in each intensively played-back video segment as selected video frames. ### Claim 11 (depends on 1) The method according to claim 1, wherein the step of selecting at least one intensively played-back video frame from the video comprises: selecting a first predetermined number of video frames among the video frames having the maximum degrees of playback intensity as the selected video frames. ### Claim 12 (depends on 1) The method according to claim 1, wherein the step of splicing the selected video frames to form the video frame set comprises: sequentially splicing the selected video frames according to the playback time sequence of the selected video frames in the video, to form the video frame set. ### Claim 13 A device for producing a video frame set, comprising: a statistic apparatus configured to compile statistics on a degree of playback intensity of each video frame in a video; a video frame selection apparatus configured to select at least one intensively played-back video frame from the video on a basis of the degree of playback intensity, wherein the degree of playback intensity of the video frame is a ratio between the number of times that the video frame is played back and the number of times the video is played back; a video frame screening apparatus configured to screen out video frames which have degrees of playback intensity greater than a predetermined threshold, wherein among the screened-out video frames, if multiple video frames are consecutive, the multiple video frames are considered as an intensively played-back video segment, and if a video frame is not consecutive with any other video frames, the video frame is considered as a separated video segment; and a video frame extraction apparatus configured to extract at least one video frame from at least one intensively played-back video segment or separated video segment video segment as selected video frames; and a splicing apparatus configured to splice the selected video frames to form the video frame set. ### Claim 14 (depends on 13) The device according to claim 13, wherein the video frame selection apparatus further comprises: a frame number determination apparatus configured to determine the number of selected video frames extracted from each intensively played-back video segment. ### Claim 15 (depends on 14) The device according to claim 14, wherein the frame number determination apparatus comprises: an average degree of playback intensity calculation apparatus configured to calculate an average degree of playback intensity of all video frames in each intensively played-back video segment; a proportion calculation apparatus configured to calculate a proportion of video frames, of which the degrees of playback intensity are greater than or equal to the average degree of playback intensity, in each intensively played-back video segment; and a first frame number determination apparatus configured to determine, according to the proportion, the number of selected video frames extracted from each intensively played-back video segment. ### Claim 16 (depends on 15) The device according to claim 15, wherein the first frame number determination apparatus is specifically configured to gradually reduce, according to the proportion from large to small, the number of selected video frames extracted from each intensively played-back video segment. ### Claim 17 (depends on 14) The device according to claim 14, wherein the frame number determination apparatus comprises: a video segment length determination apparatus configured to determine the length of each intensively played-back video segment; and a second frame number determination apparatus configured to determine, according to the length of each intensively played-back video segment, the number of selected video frames extracted from each intensively played-back video segment. ### Claim 18 (depends on 17) The device according to claim 17, wherein the second frame number determination apparatus is specifically configured to gradually reduce, according to the length of each intensively played-back video segment from long to short, the number of selected video frames extracted from each intensively played-back video segment. ### Claim 19 A server, comprising: a transceiver configured to compile statistics on a degree of playback intensity of each video frame in a video; and a processor configured to perform operations comprising: selecting at least one intensively played-back video frame from the video on a basis of the degree of playback intensity, wherein the degree of playback intensity of the video frame is a ratio between the number of times that the video frame is played back and the number of times the video is played back, wherein selecting the at least one intensively played-back video frame from the video on the basis of the degree of playback intensity comprises: screening out video frames which have degrees of playback intensity greater than a predetermined threshold, wherein among the screened-out video frames, if multiple video frames are consecutive, the multiple video frames are considered as an intensively played-back video segment, and if a video frame is not consecutive with any other video frames, the video frame is considered as a separated video segment; and extracting at least one video frame from at least one intensively played-back video segment or separated video segment as selected video frames; and splicing the selected video frames to form a video frame set. ### Claim 20 (depends on 19) The server according to claim 19, wherein selecting, by the processor, at least one intensively played-back video frame from the video further comprises: determining the number of selected video frames extracted from each intensively played-back video segment. ### Claim 21 (depends on 20) The server according to claim 20, wherein determining, by the processor, the number of selected video frames extracted from each intensively played-back video segment comprises: calculating an average degree of playback intensity of all video frames in each intensively played-back video segment; calculating a proportion of video frames, of which the degrees of playback intensity are greater than or equal to the average degree of playback intensity, in each intensively played-back video segment; and determining, according to the proportion, the number of selected video frames extracted from each intensively played-back video segment. ### Claim 22 (depends on 21) The server according to claim 21, wherein determining, by the processor, according to the proportion, the number of selected video frames extracted from each intensively played-back video segment comprises: gradually reducing, according to the proportion from large to small, the number of selected video frames extracted from each intensively played-back video segment. ### Claim 23 (depends on 20) The server according to claim 20, wherein determining, by the processor, the number of selected video frames extracted from each intensively played-back video segment comprises: determining the length of each intensively played-back video segment; and determining, according to the length of each intensively played-back video segment, the number of selected video frames extracted from each intensively played-back video segment. ### Claim 24 (depends on 23) The server according to claim 23, wherein determining, by the processor, according to the length of each intensively played-back video segment, the number of selected video frames extracted from each intensively played-back video segment comprises: gradually reducing, according to the length of each intensively played-back video segment from long to short, the number of selected video frames extracted from each intensively played-back video segment. ### Claim 25 A non-transitory computer readable storage medium, comprising computer execution instructions, such that, when a processor of a computer executes the computer execution instructions, the computer performs a method for producing a video frame set comprising: compiling statistics on a degree of playback intensity of each video frame in a video; selecting at least one intensively played-back video frame from the video on the basis of the degree of playback intensity, wherein the degree of playback intensity of the video frame is a ratio between the number of times that the video frame is played back and the number of times the video is played back, wherein selecting the at least one intensively played-back video frame from the video on the basis of the degree of playback intensity comprises: screening out video frames which have degrees of playback intensity greater than a predetermined threshold, wherein among the screened-out video frames, if multiple video frames are consecutive, the multiple video frames are considered as an intensively played-back video segment, and if a video frame is not consecutive with any other video frames, the video frame is considered as a separated video segment; and extracting at least one video frame from at least one intensively played-back video segment or separated video segment as selected video frames; and splicing the selected video frames to form the video frame set.