# US 2010/0169906 A1 · User-Annotated Video Markup > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2010/0169906 A1 - Document ID: US20100169906A1 - Status: Published application - Kind: A1 - Application number: 12/345,843 - Filed: 2008-12-30 - Published: 2010-07-01 - Earliest claimed: 2008-12-30 - Assignees: Microsoft Corporation - Inventors: Eduardo S. C. Takahashi - Web page: https://patentgrep.com/patent/US20100169906A1 ## CPC - H04N 21/84: Generation or processing of descriptive data, e.g. content descriptors {(systems specially adapted for using meta-information in broadcast systems H04H60/73)} - G11B 27/10: Indexing; Addressing; Timing or synchronising; Measuring tape travel - G11B 27/105: {of operating discs} - H04N 21/43074: {of additional data with content streams on the same device, e.g. of EPG data or interactive icon with a TV programme} - H04N 21/4325: {by playing back content from the storage medium (reproduction of recorded television signals H04N5/76; reproduction of recorded television signals H04N9/79)} - H04N 21/475: End-user interface for inputting end-user data, e.g. personal identification number [PIN], preference data - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R) ## Abstract User-annotated video markup is described. In embodiments, recorded video content can be rendered for display, and an annotation input can be received that is associated with a displayed segment of the recorded video content. The annotation input can be synchronized with synchronization data that corresponds to the displayed segment of the recorded video content, and then a video markup data file can be generated that includes the annotation input, the synchronization data, and a reference to the recorded video content. ## Claims ### Claim 1 A method, comprising: rendering recorded video content for display; receiving an annotation input that is associated with a displayed segment of the recorded video content; synchronizing the annotation input with synchronization data that corresponds to the displayed segment of the recorded video content; and generating a video markup data file that includes at least the annotation input, the synchronization data, and a reference to the recorded video content. ### Claim 2 (depends on 1) A method as recited in claim 1, further comprising communicating the video markup data file to be maintained for on-demand requests along with the recorded video content. ### Claim 3 (depends on 1) A method as recited in claim 1, wherein the recorded video content is not modified when the video markup data file is generated. ### Claim 4 (depends on 1) A method as recited in claim 1, wherein the annotation input includes context information that is associated with the displayed segment of the recorded video content. ### Claim 5 (depends on 1) A method as recited in claim 1, wherein the annotation input is received to include display content, display position data associated with the display content, and a display time that indicates a display duration of the display content. ### Claim 6 (depends on 5) A method as recited in claim 5, wherein the display content is at least one of text, an image, audio, video, a shortcut, a hyperlink, or a graphic. ### Claim 7 (depends on 1) A method as recited in claim 1, further comprising receiving the recorded video content as a requested video-on-demand. ### Claim 8 (depends on 7) A method as recited in claim 7, further comprising: receiving an additional video markup data file that is associated with the recorded video content; and generating the video markup data file to include the additional video markup data file. ### Claim 9 (depends on 8) A method as recited in claim 8, further comprising correlating an additional annotation input from the additional video markup data file with the recorded video content to render the recorded video content for display with the additional annotation input. ### Claim 10 A video markup system, comprising: a content rendering system configured to render recorded video content for display; a user interface configured for user interaction to initiate an annotation input that is associated with a displayed segment of the recorded video content; a video markup application configured to: synchronize the annotation input with synchronization data that corresponds to the displayed segment of the recorded video content; and generate a video markup data file that includes at least the annotation input, the synchronization data, and a reference to the recorded video content. ### Claim 11 (depends on 10) A video markup system as recited in claim 10, wherein the video markup application is further configured to initiate communication of the video markup data file to be maintained for on-demand requests along with the recorded video content. ### Claim 12 (depends on 10) A video markup system as recited in claim 10, wherein the video markup application is further configured to generate the video markup data file without modification to the recorded video content. ### Claim 13 (depends on 10) A video markup system as recited in claim 10, wherein the video markup application is further configured to receive the annotation input as context information that is associated with the displayed segment of the recorded video content. ### Claim 14 (depends on 10) A video markup system as recited in claim 10, wherein the video markup application is further configured to receive the annotation input that includes display content, display position data associated with the display content, and a display time that indicates a display duration of the display content. ### Claim 15 (depends on 14) A video markup system as recited in claim 14, wherein the display content is at least one of text, an image, or a graphic. ### Claim 16 (depends on 10) A video markup system as recited in claim 10, further comprising a media content input configured to receive the recorded video content as a requested video-on-demand. ### Claim 17 Computer-readable media comprising computer-executable instructions that, when executed, initiate a video markup application to: receive an annotation input that is associated with a displayed segment of recorded video content; synchronize the annotation input with synchronization data that corresponds to the displayed segment of the recorded video content; and generate a video markup data file that includes at least the annotation input, the synchronization data, and a reference to the recorded video content. ### Claim 18 (depends on 17) Computer-readable media as recited in claim 17, further comprising computer-executable instructions that, when executed, initiate the video markup application to initiate communication of the video markup data file to be maintained for on-demand requests along with the recorded video content. ### Claim 19 (depends on 17) Computer-readable media as recited in claim 17, further comprising computer-executable instructions that, when executed, initiate the video markup application to receive the annotation input as including display content, display position data associated with the display content, and a display time that indicates a display duration of the display content. ### Claim 20 (depends on 17) Computer-readable media as recited in claim 17, further comprising computer-executable instructions that, when executed, initiate the video markup application to initiate display of a user interface for user interaction via which the annotation input is received and associated with the displayed segment of the recorded video content.