# US 10,311,102 B2 · System, method and computer program product for processing video data > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,311,102 B2 - Document ID: US10311102B2 - Status: Granted - Kind: B2 - Application number: 15/194,842 - Filed: 2016-06-28 - Published: 2017-02-02 - Granted: 2019-06-04 - Earliest claimed: 2009-03-24 - Applicants: Angelo J. Pino, Jr.; Mohammed Sattar - Inventors: Angelo J. Pino, Jr.; Mohammed Sattar - Web page: https://patentgrep.com/patent/US10311102B2 ## CPC - G06F 16/738: Presentation of query results - G06F 16/78: Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually - G06F 16/7844: {using original textual content or text extracted from visual content or transcript of audio data} - H04N 5/445: for displaying additional information (H04N5/50 takes precedence) - H04N 21/26603: {for automatically generating descriptors from content, e.g. when it is not made available by its provider, using content analysis techniques} - H04N 21/2668: Creating a channel for a dedicated end-user group, e.g. insertion of targeted commercials based on end-user profiles {(information retrieval from the Internet by querying with filtering and personalisation G06F16/9535; arrangements for replacing or switching information during the broadcast H04H20/10; push services over packet-switching network H04L12/1859; adaptation of message content in packet-switching networks H04L51/063)} - H04N 21/4668: {for recommending content, e.g. movies} - H04N 21/4756: {for rating content, e.g. scoring a recommended movie} - H04N 21/4828: {for searching programme descriptors (retrieval of video data G06F16/739)} - H04N 21/8405: represented by keywords - H04N 21/812: {involving advertisement data (advertising per se G06Q30/02)} - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract A system, method and computer program product for processing video is provided. In one embodiment, the method includes storing a plurality of transcripts in a memory along with information identifying an associated video content unit, receiving a search request comprising one or more keywords originating from a user, searching at least some of the plurality of transcripts for the one or more keywords, determining search results that comprises a plurality of video content units that satisfy a similarity threshold with the search request, wherein the plurality of video content units that satisfy a similarity threshold with the search request comprise video content units having a transcript that includes at least some of the one or more keywords, and transmitting information identifying at least some of the video content units of the search results to a remote device for presentation to the user. ## Claims ### Claim 1 A method, implemented on a cable network comprising a cable head end, at least one set top box connected to the cable head end, and a computer system in communication with the cable head end, for processing video content and viewing the video content through the at least one set top box in communication with the computer system via the cable head end, comprising: processing by the computer system audio portions of a plurality of video content units to create a transcript for each of the plurality of video content units that comprises a textual representation of the dialogue of each video content unit, wherein said processing comprises extracting one of closed caption data and embedded video text from the plurality of video content units; storing by the computer system a transcript in a memory of the computer system for each of the plurality of video contents; receiving by the cable head end and the cable head end sending to the computer system a search request from a first set top box comprising one or more keywords originating from a first user; searching by the computer system at least some of a plurality of transcripts stored in the memory for the one or more keywords; identifying by the computer system the search results that comprises a set of video content units having transcripts that satisfy a similarity threshold with the search request; receiving by the cable head end and the cable head end sending to the computer system a user quality rating for each video content unit of a multitude of the video content units from a plurality of set top boxes originating from a plurality of users; based on user quality ratings, storing by the computer system an average quality rating in the memory in association with each of the respective video content units in the multitude of video content units; sorting by the computer system the search results in according to the average quality rating; receiving by the cable head end and the cable head end sending to the computer system a search request for a threshold average quality rating from the first set top box by the first user; and transmitting by the computer system at least a portion of the sorted search results that meet the threshold average quality rating to the cable head end and the cable head end sending to first set top box for viewing by the first user. ### Claim 2 (depends on 1) The method of claim 1, wherein the content units comprise an MPEG video files compatible with an MPEG decoder. ### Claim 3 (depends on 1) The method of claim 1, wherein at least some of the plurality of video content units comprises live broadcast video content. ### Claim 4 (depends on 1) The method according to claim 1, further comprising the computer system is in communication with the internet. ### Claim 5 (depends on 4) The method according to claim 4, further comprising receiving by the cable head end and the cable head end sending to the computer system a search request from a first remote device comprising one or more keywords originating from a second user; receiving by the cable head end and the cable head end sending to the computer system a search request for a threshold average quality rating from the first remote device by the second user; and transmitting by the computer system at least a portion of the sorted search results that meet the threshold average quality rating to the cable head end and the cable head end sending to first remote device for viewing by the second user. ### Claim 6 (depends on 5) The method according to claim 5, wherein the first remote device is a telephone. ### Claim 7 (depends on 1) The method of claim 1, wherein at least some of the plurality of video content units comprises a movie or a television program. ### Claim 8 (depends on 1) The method according to claim 1, further comprising extracting additional information from the video content units, storing the additional information in the memory, the additional information comprising at least one of a channel on which the video content is to be broadcast, a title, a subject, a description, a speaker or creator of the audio in the video content unit, Motion Picture Association of American (MPAA) rating information, duration, an availability date of the video content unit, pricing information associated with the video content unit, a media type, or a genre of media featured in the content unit, searching by the computer system the additional information for the one or more keywords; identifying by the computer system the search results that comprises a set of video content units having additional information that satisfy a similarity threshold with the search request; sorting by the computer system the search results in according to the average quality rating; receiving by the cable head end and the cable head end sending to the computer system a search request for a threshold average quality rating from the first set top box by the first user; and transmitting by the computer system at least a portion of the sorted search results that meet the threshold average quality rating to the cable head end and the cable head end sending to first set top box for viewing by the first user. ### Claim 9 (depends on 1) The method according to claim 1, transmitting by the computer system at least a portion of the sorted search results that meet a highest rated content type to the cable head end and the cable head end sending to first set top box for viewing by the first user. ### Claim 10 (depends on 1) The method according to claim 1, transmitting by the computer system at least a portion of the sorted search results that meet a highest rated content for a particular time to the cable head end and the cable head end sending to first set top box for viewing by the first user. ### Claim 11 (depends on 1) The method according to claim 1, further comprising accessing by the computer system each video content unit to process the video content unit to obtain a transcript of the dialogue of each video content unit for storage in the memory. ### Claim 12 (depends on 1) The method according to claim 1, wherein after receiving the keyword request from the first user said computer system generating a plurality of suggested keywords and sending the suggested keywords to the cable head end and the cable head end sending the suggested keywords to the first set top box for viewing by the first user. ### Claim 13 (depends on 12) The method of claim 12, further comprising the computer system receiving a selection of one of the suggested keywords from the first user. ### Claim 14 (depends on 1) The method of claim 1, further comprising selecting a video content by the first user, the cable head end sending to the first set top box the selected video content, and displaying to the first user the selected video content. ### Claim 15 (depends on 14) The method according to claim 14, further comprising displaying a request to rate the video content and wherein first user rating data is received in response to said displaying. ### Claim 16 (depends on 15) The method of claim 15, wherein said request is displayed while the video content is being presented. ### Claim 17 (depends on 1) The method of claim 1, further comprising by the computer system selecting an advertisement based on the keyword and sending the advertisement to the cable headend, sending by the cable head end to the first set top box the advertisement. ### Claim 18 (depends on 16) The method of claim 16, further comprising receiving a notification indicating a first user response to the advertisement; and in response, transmitting additional information to the first set top box related to a product or service advertised in the first advertisement. ### Claim 19 (depends on 12) The method according to claim 12, wherein the suggested keywords are formulated into queries which are dynamically generated as needed by a user with a form that is unknown until the query is received by the computer system and which form is likely to change between different requests. ### Claim 20 (depends on 12) The method according to claim 12, further comprising receiving by the cable head end a selected suggested keyword from the first set top box and the cable head end sending the selected suggested keyword to the computer system; searching by the computer system at least some of a plurality of transcripts stored in the memory for the suggested keyword; identifying by the computer system the search results that comprises a set of video content units having transcripts that satisfy a similarity threshold with the search request; sorting by the computer system the search results in according to the average quality rating; receiving by the cable head end and the cable head end sending to the computer system a search request for a threshold average quality rating from the first set top box by the first user; and transmitting by the computer system at least a portion of the sorted search results that meet the threshold average quality rating to the cable head end and the cable head end sending to first set top box for viewing by the first user.