Method, device, storage medium and program product for music screening

A terminal device, comprising:

• a processor and a memory;
• the memory storing computer-executed instructions;
• the processor executing the computer-executed instructions stored in the memory, causing the processor to perform a method of music screening for automatic soundtrack generation in a video editing system, the method comprising:
• obtaining at least one image and at least one piece of to-be-selected music;
• determining, by an image analysis model, an analysis result of the at least one image corresponding to an image classification tag based on N predetermined image classification tags, N being an integer greater than or equal to 1;
• determining, by a music matching model, attribute information for each of the at least one piece of to-be-selected music based on the at least one image and the at least one piece of to-be-selected music;
• and
• determining a target music that matches the at least one image among the at least one piece of to-be-selected music based on the analysis result obtained from the image analysis model and the attribute information of each of the at least one piece of to-be-selected music obtained from the music matching model;
• wherein the determining the target music that matches the at least one image among the at least one piece of to-be-selected music comprises:
• for a piece of music of the at least one piece of to-be-selected music, determining at least one first score of the piece of music corresponding to at least one image classification tag based on the analysis result and the attribute information of the piece of music;
• determining a target score of the piece of music based on the at least one first score corresponding to the at least one image classification tag and an initial score of the piece of music, the initial score of the piece of music being included in the attribute information of the piece of music, comprising:
• obtaining, by the processor, respective weights of the N image classification tags, the weights being preset and periodically updated based on accumulated matching data;
• and
• determining, by the processor, the target score of the piece of music based on N first scores corresponding to the N image classification tags, the respective weights of the N image classification tags and the initial score of the piece of music;
• and
• determining the target music based on at least one respective target score of the at least one piece of to-be-selected music, comprising:
• obtaining, by the processor, a music sequence by ranking the at least one piece of to-be-selected music in an order of the at least one respective target score of the at least one piece of to-be-selected music;
• and
• determining, by the processor, a predetermined number of pieces of to-be-selected music ranking at a top of the music sequence as the target music that matches the at least one image, and automatically inserting the target music as a synchronized soundtrack into a user-generated video comprising the at least one image.

A non-transitory computer-readable storage medium, wherein computer-executed instructions are stored in the computer-readable storage medium, the computer-executed instructions, when executed by a processor, performing a method of music screening for automatic soundtrack generation in a video editing system, the method comprising:

• obtaining, by a processor, at least one image and at least one piece of to-be-selected music;
• determining, by an image analysis model, an analysis result of the at least one image corresponding to an image classification tag based on N predetermined image classification tags, N being an integer greater than or equal to 1;
• determining, by a music matching model, attribute information for each of the at least one piece of to-be-selected music based on the at least one image and the at least one piece of to-be-selected music;
• and
• determining, by the processor, a target music that matches the at least one image among the at least one piece of to-be-selected music based on the analysis result obtained from the image analysis model and the attribute information of each of the at least one piece of to-be-selected music obtained from the music matching model;
• wherein the determining the target music that matches the at least one image among the at least one piece of to-be-selected music comprises:
• for a piece of music of the at least one piece of to-be-selected music, determining at least one first score of the piece of music corresponding to at least one image classification tag based on the analysis result and the attribute information of the piece of music;
• determining, by the processor, a target score of the piece of music based on the at least one first score corresponding to the at least one image classification tag and an initial score of the piece of music, the initial score of the piece of music being included in the attribute information of the piece of music, comprising:
• obtaining, by the processor, respective weights of the N image classification tags, the weights being preset and periodically updated based on accumulated matching data;
• and
• determining, by the processor, the target score of the piece of music based on N first scores corresponding to the N image classification tags, the respective weights of the N image classification tags and the initial score of the piece of music;
• and
• determining, by the processor, the target music based on at least one respective target score of the at least one piece of to-be-selected music, comprising:
• obtaining, by the processor, a music sequence by ranking the at least one piece of to-be-selected music in an order of the at least one respective target score of the at least one piece of to-be-selected music;
• and
• determining, by the processor, a predetermined number of pieces of to-be-selected music ranking at a top of the music sequence as the target music that matches the at least one image, and automatically inserting the target music as a synchronized soundtrack into a user-generated video comprising the at least one image.