Determining musical style using a variational autoencoder
AssigneeSpotify AB
InventorAparna Kumar
Life of this patent
Estimating the term…
Abstract
A computer extracts a vocal portion from a first audio content item and determines a first representative vector that corresponds to a vocal style of the first audio content item by applying a variational autoencoder (VAE) to the extracted vocal portion of the representation of the audio content item. The computer streams, to an electronic device, a second audio content item, selected from a plurality of audio content items, that has a second representative vector that corresponds to a vocal style of the second audio content item, wherein the second representative vector that corresponds the vocal style of the second audio content item meets similarity criteria with respect to the first representative vector that corresponds to the vocal style of the first audio content item.
Claims17
A method, comprising:
- at a computer system having one or more processors and memory storing instructions for execution by the one or more processors:
- extracting a vocal portion from a first audio content item that includes the vocal portion and a non-vocal portion;
- determining a first representative vector that corresponds to a vocal style of the first audio content item by applying a variational autoencoder (VAE) to the extracted vocal portion of the first audio content item;
- and
- streaming, to an electronic device, a second audio content item, selected from a plurality of audio content items, that has a second representative vector that corresponds to a vocal style of the second audio content item, wherein:
- the second representative vector that corresponds the vocal style of the second audio content item meets similarity criteria with respect to the first representative vector that corresponds to the vocal style of the first audio content item.
A non-transitory computer-readable storage medium having one or more processors and memory storing instructions for execution by the one or more processors, including instructions for:
- extracting a vocal portion from a first audio content item that includes the vocal portion and a non-vocal portion;
- determining a first representative vector that corresponds to a vocal style of the first audio content item by applying a variational autoencoder (VAE) to the extracted vocal portion of the first audio content item;
- and
- streaming, to an electronic device, a second audio content item, selected from a plurality of audio content items, that has a second representative vector that corresponds to a vocal style of the second audio content item, wherein:
- the second representative vector that corresponds the vocal style of the second audio content item meets similarity criteria with respect to the first representative vector that corresponds to the vocal style of the first audio content item.
A server system of a media-providing service, comprising:
- one or more processors;
- and
- memory storing instructions for execution by the one or more processors, including instructions for:
- extracting a vocal portion from a first audio content item that includes the vocal portion and a non-vocal portion;
- determining a first representative vector that corresponds to a vocal style of the first audio content item by applying a variational autoencoder (VAE) to the extracted vocal portion of the first audio content item;
- and
- streaming, to an electronic device, a second audio content item, selected from a plurality of audio content items, that has a second representative vector that corresponds to a vocal style of the second audio content item, wherein:
- the second representative vector that corresponds the vocal style of the second audio content item meets similarity criteria with respect to the first representative vector that corresponds to the vocal style of the first audio content item.
Dependencies are inferred from the claim text.