# US 2014/0208355 A1 · Synchronizing video content with extrinsic data > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2014/0208355 A1 - Document ID: US20140208355A1 - Status: Published application - Kind: A1 - Application number: 14/225,864 - Filed: 2014-03-26 - Published: 2014-07-24 - Earliest claimed: 2011-09-07 - Assignees: IMDb.com, Inc. - Applicants: IMDb.com, Inc. - Inventors: Andrej Gregov; Francis J. Kane; Douglas M. Treder - Web page: https://patentgrep.com/patent/US20140208355A1 ## CPC - H04N 21/4725: using interactive regions of the image, e.g. hot spots {(details of information retrieval from the Internet by using URLs G06F16/955; processing chained hypermedia data for information retrieval G06F16/94)} - G06Q 90/00: Systems or methods specially adapted for administrative, commercial, financial, managerial or supervisory purposes, not involving significant data processing - H04N 21/235: Processing of additional data, e.g. scrambling of additional data or processing content descriptors - H04N 21/25866: {Management of end-user data (customer care in data networks H04L41/5077)} - H04N 21/25891: {being end-user preferences (retrieval of video data in a video database based on user preferences G06F16/739; arrangements for recognizing users' preferences H04H60/46; user profiles in network data switching protocols H04L67/306; processing of user preferences or user profiles in wireless networks H04W8/18)} - H04N 21/41265: {having a remote control device for bidirectional communication between the remote control device and client device (unidirectional remote control device H04N21/42204)} - H04N 21/43074: {of additional data with content streams on the same device, e.g. of EPG data or interactive icon with a TV programme} - H04N 21/43079: {of additional data with content streams on multiple devices} - H04N 21/4316: {for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window} - H04N 21/4394: {involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams (arrangements characterised by components specially adapted for monitoring, identification or recognition of audio in broadcast systems H04H60/58)} - H04N 21/44008: {involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream (arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59)} - H04N 21/44204: {Monitoring of content usage, e.g. the number of times a movie has been viewed, copied or the amount which has been watched (monitoring of user activities for profile generation for accessing a video database G06F16/739; protecting generic digital content where the protection is independent of the precise nature of the content G06F21/10; arrangements for monitoring the use made of the broadcast services in broadcast systems H04H60/31)} - H04N 21/4532: {involving end-user characteristics, e.g. viewer profile, preferences (monitoring of user activities for profile generation for accessing a video database G06F16/739; user profiles in network data switching protocols H04L67/306; processing of user preferences or user profiles in wireless networks H04W8/18)} - H04N 21/4722: for requesting additional data associated with the content - H04N 21/4756: {for rating content, e.g. scoring a recommended movie} - H04N 21/654: Transmission by server directed to the client - H04N 21/6587: Control parameters, e.g. trick play commands, viewpoint selection - H04N 21/8133: {specifically related to the content, e.g. biography of the actors in a movie, detailed information about an article seen in a video programme} - H04N 21/84: Generation or processing of descriptive data, e.g. content descriptors {(systems specially adapted for using meta-information in broadcast systems H04H60/73)} - H04N 21/8547: involving timestamps for synchronizing content - H04N 21/4431: {characterized by the use of Application Program Interface [API] libraries} - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR ## Abstract Disclosed are various embodiments for associating and synchronizing extrinsic data with video content at particular points of time in the video content. A user interface is rendered that facilitates a selection from extrinsic data items that are associated with a video content feature that is currently being presented to a user. A user selection of a particular extrinsic data item is received through the user interface, and a time in the video content feature is determined corresponding to the user selection. An association is then generated between the particular extrinsic data item and the time in the video content feature. ## Claims ### Claim 1 A method, comprising: causing, via at least one of one or more computing devices, a user interface to be rendered that facilitates a selection from a plurality of extrinsic data items that are associated with a video content feature that is currently being presented to a user; receiving, via at least one of the one or more computing devices, a user selection of a particular extrinsic data item of the plurality of extrinsic data items through the user interface; determining, via at least one of the one or more computing devices, a time in the video content feature that is currently being presented to the user, the time corresponding to the user selection; and generating, via at least one of the one or more computing devices, an association between the particular extrinsic data item and the time in the video content feature in response to the user selection. ### Claim 2 (depends on 1) The method of claim 1, wherein the time corresponds to at least one frame number in the video content feature. ### Claim 3 (depends on 1) The method of claim 1, further comprising: determining, via at least one of the one or more computing devices, a graphical position relative to at least one frame of the video content feature corresponding to the user selection; and wherein the association that is generated further associates the graphical position with the particular extrinsic data item and the time in the video content feature. ### Claim 4 (depends on 1) The method of claim 1, wherein the user interface is rendered by a first computing device of the one or more computing devices and the video content feature is presented to the user by way of a second computing device of the one or more computing devices. ### Claim 5 (depends on 4) The method of claim 4, further comprising communicating between the first computing device and the second computing device to determine the time in the video content feature. ### Claim 6 (depends on 1) The method of claim 1, wherein the plurality of extrinsic data items correspond to a subset of extrinsic data items that are associated with the video content feature. ### Claim 7 (depends on 1) The method of claim 1, wherein determining the time in the video content feature corresponding to the user selection further comprises determining, via at least one of the one or more computing devices, the time in the video content feature corresponding to the user selection using a fingerprinting approach. ### Claim 8 (depends on 1) The method of claim 1, wherein the plurality of extrinsic data items correspond to a plurality of persons appearing in the video content feature, and the user selection indicates that a particular person of the plurality of persons is appearing in the video content feature relative to the time. ### Claim 9 (depends on 1) The method of claim 1, further comprising: determining, via at least one of the one or more computing devices, another time in the video content feature; receiving, via at least one of the one or more computing devices, at least one extrinsic data item based at least in part on the other time in the video content feature; and causing, via at least one of the one or more computing devices, the at least one extrinsic data item to be rendered relative to the other time in the video content feature. ### Claim 10 (depends on 9) The method of claim 9, further comprising: causing, via at least one of the one or more computing devices, the video content feature to be rendered; and wherein causing the at least one extrinsic data item to be rendered further comprises causing, via at least one of the one or more computing devices, the at least one extrinsic data item to be rendered in visual association with the video content feature. ### Claim 11 (depends on 10) The method of claim 10, wherein causing the video content feature to be rendered further comprises: determining, via at least one of the one or more computing devices, a point of resumption for the video content feature, the point of resumption corresponding to a time in the video content feature at which presentation to the user was stopped; and causing, via at least one of the one or more computing devices, the video content feature to be rendered beginning at the point of resumption. ### Claim 12 A system, comprising: at least one computing device; and at least one service executable in the at least one computing device, the at least one service comprising: logic that causes a user interface to be rendered that facilitates a selection from a plurality of extrinsic data items that are associated with a video content feature that is currently being presented to a user; logic that determines a time in the video content feature that is currently being presented to the user, the time corresponding to a user selection of a particular extrinsic data item of the plurality of extrinsic data items received through the user interface; and logic that generates an association between the particular extrinsic data item and the time in the video content feature in response to the user selection. ### Claim 13 (depends on 12) The system of claim 12, wherein the at least one service further comprises logic that stores the association in an extrinsic data library. ### Claim 14 (depends on 12) The system of claim 12, wherein the at least one service further comprises: logic that determines a time in the video content feature at which delivery of the video content feature to the user was stopped; and logic that commences streaming of the video content feature relative to the time in the video content feature at which delivery of the video content feature to the user was stopped. ### Claim 15 (depends on 12) The system of claim 12, wherein the at least one service further comprises logic that determines whether the association is valid based at least in part on at least one other association with the time in the video content feature made by at least one other user. ### Claim 16 (depends on 12) The system of claim 12, wherein the at least one service further comprises: logic that determines a graphical position relative to at least one frame of the video content feature corresponding to the user selection; and wherein the association that is generated further associates the graphical position with the particular extrinsic data item and the time in the video content feature. ### Claim 17 (depends on 12) The system of claim 12, wherein the plurality of extrinsic data items correspond to a subset of extrinsic data items that are associated with the video content feature. ### Claim 18 A non-transitory computer-readable medium embodying at least one program executable in at least one computing device, comprising: code that causes a user interface to be rendered that facilitates a selection from a plurality of extrinsic data items that are associated with a video content feature that is currently being presented to a user; code that determines a time in the video content feature that is currently being presented to the user, the time corresponding to a user selection of a particular extrinsic data item of the plurality of extrinsic data items received through the user interface; and code that generates an association between the particular extrinsic data item and the time in the video content feature in response to the user selection. ### Claim 19 (depends on 18) The non-transitory computer-readable medium of claim 18, further comprising code that determines whether the association is valid based at least in part on at least one other association with the time in the video content feature made by at least one other user. ### Claim 20 (depends on 18) The non-transitory computer-readable medium of claim 18, wherein the plurality of extrinsic data items correspond to a plurality of persons appearing in the video content feature, and the user selection indicates that a particular person of the plurality of persons is appearing in the video content feature relative to the time.