# US 2019/0174191 A1 · System and Method for Integrating Interactive Call-To-Action, Contextual Applications with Videos > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2019/0174191 A1 - Document ID: US20190174191A1 - Status: Published application - Kind: A1 - Application number: 16/000,727 - Filed: 2018-06-05 - Published: 2019-06-06 - Earliest claimed: 2009-09-01 - Assignees: 2Cimple, Inc. - Applicants: 2Cimple, Inc. - Inventors: Syed Athar Abbas; Mubashir Ahmad; Muhammad Rais-ul-Rehman Ali; Ali Mohiuddin; Sridhar Sanapala; Farrukh Ismail; Usman Haroon; Ata Kirmani - Web page: https://patentgrep.com/patent/US20190174191A1 ## CPC - H04N 21/4725: using interactive regions of the image, e.g. hot spots {(details of information retrieval from the Internet by using URLs G06F16/955; processing chained hypermedia data for information retrieval G06F16/94)} - G06F 3/0481: based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance - G06F 3/04842: Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence) - G11B 27/034: on discs (G11B27/036, G11B27/038 take precedence) - G11B 27/036: Insert-editing - G11B 27/34: Indicating arrangements {(indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D)} - H04N 21/23418: {involving operations for analysing video streams, e.g. detecting features or characteristics (television picture signal circuitry for scene change detection H04N5/147; filtering for image enhancement G06T5/00; methods or arrangements for recognising scenes G06V20/00; arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59)} - H04N 21/234318: {by decomposing into objects, e.g. MPEG-4 objects} - H04N 21/4312: {involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations} - H04N 21/44012: {involving rendering scenes according to scene graphs, e.g. MPEG-4 scene graphs} - H04N 21/6125: {involving transmission via Internet (transmission by internet of broadcast information H04H60/82)} - H04N 21/6587: Control parameters, e.g. trick play commands, viewpoint selection - H04N 21/812: {involving advertisement data (advertising per se G06Q30/02)} - H04N 21/8166: {involving executable data, e.g. software (arrangements for executing specific programs G06F9/44; broadcasting computer programmes in broadcast systems H04H20/91; involving the movement of software or configuration parameters H04L67/34)} - H04N 21/8583: {by creating hot-spots} - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R) ## Abstract A system, computer-readable medium and method of delivering an interactive video application includes identifying a hotspot in a portion of a video content. A hypercode object is overlayed on the hotspot at a spatial point. The hypercode object is displayed at a temporal point during playback of the video content. An interactive application is provided in response to activation of the hypercode object. Information is recorded corresponding to viewer interactions with the video content, including information that indicates a selection of the hotspot, a replayed portion of the video content, and a skipped portion of the video content. ## Claims ### Claim 1 A method comprising: identifying a hotspot in a portion of a video content; overlaying a hypercode object on the hotspot at a spatial point; causing the hypercode object to be displayed at a temporal point during playback of the video content; providing an interactive application in response to activation of the hypercode object; and recording information corresponding to viewer interactions with the video content, wherein the recorded information indicates a selection of the hotspot, wherein the recorded information indicates a replayed portion of the video content, and wherein the recorded information indicates a skipped portion of the video content. ### Claim 2 (depends on 1) The method of claim 1 further comprising: analyzing the video content at the spatial point and the temporal point; and isolating at least one graphical object detected in the video content at the spatial point and the temporal point. ### Claim 3 (depends on 2) The method of claim 2 further comprising: receiving a temporal range comprising a start time and an end time, wherein the starting time is the temporal point; and tracking a movement of the graphical object in the video content with the hypercode object beginning at the start time and continuing until the end time. ### Claim 4 (depends on 2) The method of claim 2 wherein the isolating the at least one graphical object comprises: isolating multiple graphical objects in the video content; providing a list of the multiple graphical objects; and receiving a selection of one graphical object from the list. ### Claim 5 (depends on 1) The method of claim 1 further comprising: defining a context for the video content; and selecting the interactive application according to the context. ### Claim 6 (depends on 1) The method of claim 1 wherein providing the interactive application further pauses playback of the video content. ### Claim 7 (depends on 1) The method of claim 1 wherein the interactive application displays advertising content. ### Claim 8 (depends on 1) The method of claim 1 further comprising modifying the timing or location of the hypercode object. ### Claim 9 (depends on 1) The method of claim 1 further comprising: making the interactive application available to a sponsor; and customizing the interactive application according to a request by the sponsor. ### Claim 10 (depends on 1) The method of claim 1 further comprising: obtaining data related to viewer interaction with the interactive application; and revising the interactive application based on the data. ### Claim 11 (depends on 1) The method of claim 1 wherein the hypercode object is an XML file. ### Claim 12 A non-transitory computer-readable medium having stored thereon instructions that are executed to perform operations comprising: identifying a hotspot in a portion of a video content; overlaying a hypercode object on the hotspot at a spatial point; causing the hypercode object to be displayed at a temporal point during playback of the video content; providing an interactive application in response to activation of the hypercode object; and recording information corresponding to viewer interactions with the video content, wherein the recorded information indicates a selection of the hotspot, wherein the recorded information indicates a replayed portion of the video content, and wherein the recorded information indicates a skipped portion of the video content. ### Claim 13 (depends on 12) The non-transitory computer-readable medium of claim 12, the operations further comprising: analyzing the video content at the spatial point and the temporal point; and isolating at least one graphical object detected in the video content at the spatial point and the temporal point. ### Claim 14 (depends on 13) The non-transitory computer-readable medium of claim 13, the operations further comprising: receiving a temporal range comprising a start time and an end time, wherein the starting time is the temporal point; and tracking a movement of the graphical object in the video content with the hypercode object beginning at the start time and continuing until the end time. ### Claim 15 (depends on 13) The non-transitory computer-readable medium of claim 13, the operations further comprising: isolating multiple graphical objects in the video content; providing a list of the multiple graphical objects; and receiving a selection of one graphical object from the list. ### Claim 16 (depends on 12) The non-transitory computer-readable medium of claim 12, the operations further comprising: defining a context for the video content; and selecting the interactive application according to the context. ### Claim 17 A system comprising: a computer readable medium having instructions, the instructions executed by at least one processor to perform operations comprising: identifying a hotspot in a portion of a video content; overlaying a hypercode object on the hotspot at a spatial point; causing the hypercode object to be displayed at a temporal point during playback of the video content; providing an interactive application in response to activation of the hypercode object; and recording information corresponding to viewer interactions with the video content, wherein the recorded information indicates a selection of the hotspot, wherein the recorded information indicates a replayed portion of the video content, and wherein the recorded information indicates a skipped portion of the video content. ### Claim 18 (depends on 17) The system of claim 17, the operations further comprising: analyzing the video content at the spatial point and the temporal point; and isolating at least one graphical object detected in the video content at the spatial point and the temporal point. ### Claim 19 (depends on 18) The system of claim 18, the operations further comprising: receiving a temporal range comprising a start time and an end time, wherein the starting time is the temporal point; and tracking a movement of the graphical object in the video content with the hypercode object beginning at the start time and continuing until the end time. ### Claim 20 (depends on 18) The system of claim 18, the operations further comprising: isolating multiple graphical objects in the video content; providing a list of the multiple graphical objects; and receiving a selection of one graphical object from the list.