System and Method for Creation and Control of Interactive User Interfaces

An interface authoring system comprising:

• a processor;
• a display operatively coupled to the processor;
• an input device operatively coupled to the processor;
• and
• a memory operatively coupled to the processor, the memory storing executable instructions that, when executed by the processor, causes the interface authoring system to perform a method for creation of interactive user interfaces that are responsive to user engagement with a computerized interaction system, the method comprising:
• processing video content segment data using computer vision analysis to generate corresponding computer vision data associated with the video content segment, the computer vision data comprising data reflective of occurrences occurring during the captured video content segment;
• interpreting the computer vision data to identify a plurality of events depicted in the captured video content segment, each of said plurality of events having a respective time of occurrence in relation to an elapsed time of the video content segment and being interpreted to correspond to an action depicted in the captured video content segment;
• for each of the plurality of events, identifying target input having a time of input corresponding to the time of occurrence of the respective event, and a type of input corresponding to the action depicted in the captured video content segment, the target input being identified as input corresponding in time and action depicted in the captured video segment;
• and
• storing a master track associated with the video content segment, the master track identifying the target input as input to be provided by the user, during display of the video content segment to the user, at the interaction system, during the interaction session.

A computer program product for implementing a method for creation of interactive user interfaces that are responsive to user engagement with a computerized interaction system, the computer program product comprising a non-transitory computer-readable medium storing executable instructions that, when executed by a processor, cause a computerized interface authoring system to perform a method comprising:

• processing video content segment data using computer vision analysis to generate corresponding computer vision data associated with the video content segment, the computer vision data comprising data reflective of occurrences occurring during the captured video content segment;
• interpreting the computer vision data to identify a plurality of events depicted in the captured video content segment, each of said plurality of events having a respective time of occurrence in relation to an elapsed time of the video content segment and being interpreted to correspond to an action depicted in the captured video content segment;
• for each of the plurality of events, identifying target input having a time of input corresponding to the time of occurrence of the respective event, and a type of input corresponding to the action depicted in the captured video content segment, the target input being identified as input corresponding in time and action depicted in the captured video segment;
• and
• storing a master track associated with the video content segment, the master track identifying the target input as input to be provided by the user, during display of the video content segment to the user, at the interaction system, during the interaction session.