System and Method for Modulating a Peripheral Device Based on an Unscripted Feed Using Computer Vision

A non-transitory computer readable medium having instructions stored thereon, when executed by a processor, cause the processor to trigger or control at least one modulation of a peripheral device corresponding to a modulation trigger-free feed (unscripted), said processor further configured to:

• receiving at least one of a video or audio signal from at least one of an original programming feed or live feed;
• and
• generating a triggering signal in response to the at least one of the video or audio signal from the at least one of the original programming source or live feed that match or exceed a threshold score for a scored event and triggering or controlling at least one modulation of the at least one peripheral device, thereby enabling modulation corresponding to at least one of the programming feed or live feed not scripted with a modulation trigger.

A method for processing at least one of an audio or video input for non-scripted modulation of at least one peripheral device, said method comprising the steps of:

• recognizing at least one of the audio or video input from the at least one of the original programming feed or live feed, and determining for at least one tagged event, at least one of a pixel color score, a pixel velocity score, an event proximity score or an audio score;
• and
• converting the at least one scored event into at least one of an output command that triggers or controls a modulation effect of the at least one peripheral device in physical contact or free from the user in communication with the at least the first device playing the at least one of the original programming feed or live feed, thereby enabling modulation of the at least one peripheral device based on any programming comprising at least one of an audio or video input and not requiring scripted modulation triggers.