# US 2013/0160057 A1 · Method for content-Based Non-Linear Control of Multimedia Playback > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2013/0160057 A1 - Document ID: US20130160057A1 - Status: Published application - Kind: A1 - Application number: 13/687,497 - Filed: 2012-11-28 - Published: 2013-06-20 - Earliest claimed: 2001-05-14 - Assignees: AT&T Intellectual Property II, L.P. - Inventors: Edward Y. Chen; David Crawford Gibbon; Laurence W. Ruedisueli; Behzad Shahraray - Web page: https://patentgrep.com/patent/US20130160057A1 ## CPC - H04N 21/47217: {for controlling playback functions for recorded or on-demand content, e.g. using progress bars, mode or play-point indicators or bookmarks (specific graphical features in visual interfaces H04N21/4312)} - G06F 16/40: of multimedia data, e.g. slideshows comprising image and additional audio data (retrieval of still image data G06F16/50; retrieval of audio data G06F16/60; retrieval of video data G06F16/70) - G06F 16/44: Browsing; Visualisation therefor - G06F 16/48: Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually - G06F 16/73: Querying - G06F 16/732: Query formulation - G06F 16/738: Presentation of query results - G06F 16/74: Browsing; Visualisation therefor (end-user interfaces for requesting or interacting with video content, e.g. video on demand interfaces or electronic programme guides, H04N21/472) - H04N 7/17336: {Handling of requests in head-ends} - H04N 21/23439: {for generating different versions} - H04N 21/26603: {for automatically generating descriptors from content, e.g. when it is not made available by its provider, using content analysis techniques} - H04N 21/278: Content descriptor database or directory service for end-user access {(details of content or meta data based information retrieval of video data in video databases G06F16/739)} - H04N 21/41407: {embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop (constructional details of equipment or arrangements specially adapted for portable computer application G06F1/1626; arrangements specially adapted for mobile receivers in broadcast systems H04H20/57)} - H04N 21/432: Content retrieval operation from a local storage medium, e.g. hard-disk {(details of retrieval of video data and associated meta data in video databases G06F16/739)} - H04N 21/4345: {Extraction or processing of SI, e.g. extracting service information from an MPEG stream} - H04N 21/44008: {involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream (arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59)} - H04N 21/4622: {Retrieving content or additional data from different sources, e.g. from a broadcast channel and the Internet (web site content organization and management for information retrieval from the Internet G06F16/958; transmission by internet of broadcast information H04H60/82; stock exchange data over packet-switching network H04L12/1804; push services including data channel over packet-switching network H04L12/1859)} - H04N 21/47202: {for requesting content on demand, e.g. video on demand} - H04N 21/4782: Web browsing {, e.g. WebTV} - H04N 21/4821: {using a grid, e.g. sorted out by channel and broadcast time} - H04N 21/4828: {for searching programme descriptors (retrieval of video data G06F16/739)} - H04N 21/6587: Control parameters, e.g. trick play commands, viewpoint selection - H04N 21/84: Generation or processing of descriptive data, e.g. content descriptors {(systems specially adapted for using meta-information in broadcast systems H04H60/73)} - H04N 21/8586: {by using a URL (processing chained hypermedia data for information retrieval G06F16/94; information retrieval from the Internet by using URLs G06F16/955; URL in broadcast information H04H20/93; Web-based protocols H04L67/02)} - H04N 21/426: Internal components of the client {; Characteristics thereof} (H04N5/44 takes precedence) - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) ## Abstract A system and method are provided for content-based non-linear control of video data playback. A multimedia database having multimedia data including multimedia content data is searched based on a user query to determine a first set of multimedia data. The multimedia data includes indexes to and condensed representations of corresponding video data stored in a video database. A portion of the first set of multimedia data is displayed at a control device in response to the user query. A user of the control device selects an element of the first set of multimedia data for video playback and video data corresponding to the element delivered to a video device for playback. A user of the control device selects an element of the first set of multimedia data for additional information and a second set of multimedia data corresponding to the element delivered to the control device. ## Claims ### Claim 1 A method comprising: receiving, from a user, a search term; transmitting the search term to a database associated with a plurality of media content, wherein the plurality of media content is indexed; receiving, from the database, matched media content associated with the search term; receiving, from the user, a choice from the matched media content to yield a selection, the choice indicating a desire of the user to play the selection; and transmitting the selection to the database. ### Claim 2 (depends on 1) The method of claim 1, wherein the plurality of media content is indexed by at least one of a title, a length, a rating, and a scene. ### Claim 3 (depends on 1) The method of claim 1, wherein the search term is received as an utterance. ### Claim 4 (depends on 3) The method of claim 3, further comprising converting the utterance to text via automatic speech recognition. ### Claim 5 (depends on 1) The method of claim 1, wherein the database comprises ancillary data used to index the plurality of media content. ### Claim 6 (depends on 5) The method of claim 5, wherein the ancillary data comprises at least one of offline transcriptions, manual annotations, topic classifications, post-production scripts, metadata, and genre classifications. ### Claim 7 (depends on 1) The method of claim 1, further comprising displaying the matched media content to the user to make the choice. ### Claim 8 (depends on 1) The method of claim 1, wherein the transmitting of the selection of the database triggers presentation of the selection on a separate device. ### Claim 9 A system comprising: a processor; and a computer-readable storage medium having instructions stored which, when executed by the processor, cause the processor to perform a method comprising: receiving, from a user, a search term; transmitting the search term to a database associated with a plurality of media content, wherein the plurality of media content is indexed; receiving, from the database, matched media content associated with the search term; receiving, from the user, a choice from the matched media content to yield a selection, the choice indicating a desire of the user to play the selection; and transmitting the selection to the database. ### Claim 10 (depends on 9) The system of claim 9, wherein the plurality of media content is indexed by at least one of a title, a length, a rating, and a scene. ### Claim 11 (depends on 9) The system of claim 9, wherein the search term is received as an utterance. ### Claim 12 (depends on 11) The system of claim 11, the computer-readable storage medium having additional instructions stored which result in the method further comprising converting the utterance to text via automatic speech recognition. ### Claim 13 (depends on 9) The system of claim 9, wherein the database comprises ancillary data used to index the plurality of media content. ### Claim 14 (depends on 13) The system of claim 13, wherein the ancillary data comprises at least one of offline transcriptions, manual annotations, topic classifications, post-production scripts, metadata, and genre classifications. ### Claim 15 (depends on 9) The system of claim 9, the computer-readable storage medium having additional instructions stored which result in the method further comprising displaying the matched media content to the user to make the choice. ### Claim 16 (depends on 9) The system of claim 9, wherein the transmitting of the selection of the database triggers presentation of the selection on a separate device. ### Claim 17 A computer-readable storage medium having instructions stored which, when executed by a computing device, cause the computing device to perform a method comprising: receiving, from a user, a search term; transmitting the search term to a database associated with a plurality of media content, wherein the plurality of media content is indexed; receiving, from the database, matched media content associated with the search term; receiving, from the user, a choice from the matched media content, the choice indicating a desire of the user to play the selection; and transmitting the selection to the database. ### Claim 18 (depends on 17) The computer-readable storage medium of claim 17, wherein the plurality of media content is indexed by at least one of a title, a length, a rating, and a scene. ### Claim 19 (depends on 17) The computer-readable storage medium of claim 17, wherein the search term is received as an utterance. ### Claim 20 (depends on 19) The computer-readable storage medium of claim 19, the computer-readable storage medium having additional instruction stored which result in the method further comprising converting the utterance to text via automatic speech recognition.