Selecting supplemental audio segments based on video analysis

A system to supplemental audio content comprising:

• one or more computing processors and memories associated with a supplemental audio content generation application, wherein the supplemental audio content generation application and is executed on a client device and wherein the supplemental audio content generation application, and one or more content generating applications are independently executable, wherein the supplemental audio content generation application is configured to:
• obtain one or more video frames generated by the one or more content generating applications for rendering on a client device, wherein the supplemental audio content generation application and the one or more content generation applications are independently executed on a client device and wherein the supplemental audio content generation application and the one or more content generating applications are decoupled and independently executable;
• process content depicted in the obtained one or more video frames to generate an attribute vector characterizing content depicted in the one or more video frames without receiving additional information from the one or more content generating applications;
• process the generated attribute vector to identify at least one audio segment based on providing the generated attributed vector as input to a machine-learned algorithm, wherein the identified at least one audio segment is adapted based, at least in part, on the generated attribute vector;
• and
• cause an independent playback of the identified at least one audio segment in correlation with rendering of the one or more content generation applications.

A method for generating supplemental content utilizing supplemental audio content generation application decoupled from one or more content generating application, the method comprising:

• obtaining, by the supplemental audio content generation application, an individual video frame generated by the one or more content generating applications, wherein the supplemental audio content generation application and the one or more content generation applications are independently executed on a client device and wherein the supplemental audio content generation application and the one or more content generating applications are decoupled and independently executable;
• processing, by the supplemental audio content generation application, content depicted in the obtained one or more video frames to generate an attribute vector characterizing content depicted in the one or more video frames without receiving additional information from the one or more content generating applications;
• processing, by the supplemental audio content generation application, the generated attribute vector to identify at least one audio segment based on a machine-learned algorithm, wherein the identified at least one audio segment is adapted based, at least in part, on the generated attribute vector;
• and
• causing, by the supplemental audio content generation application, playback of the identified at least one audio segment.