Method, device, and program for providing matching information through analysis of sound information
AssigneeCochl Inc
InventorsYoonchang Han, Jeongsoo Park, Subin Lee, Ilyoung Jeong, Hyungui Lim, Donmoon Lee
Life of this patent
Estimating the term…
Abstract
Disclosed is a method for providing matching information through the analysis of sound information according to an embodiment of the present invention. The method may include a step for acquiring the sound information, a step for acquiring user feature information on the basis of the sound information, and a step for providing the matching information corresponding to the user feature information.
Claims9
A method performed by a computing device, a user terminal, and a sensor, comprising:
- obtaining, by the user terminal, sound information;
- generating, by the user terminal, a spectrogram or a mel-spectrogram of the sound information by analyzing of the sound information;
- identifying, by the sensor that is located in a living space of a user, whether the user is located in a specific space that is the living space of the user, by recognizing radio waves transmitted from a radio-frequency identification (RFID) module of the user terminal;
- identifying, by the computing device, whether the user is located in the specific space, based on sensing information received from the sensor;
- in response to an identification that the user is located in the specific space, obtaining, by the computing device, the spectrogram or the mel-spectrogram of the sound information from the user terminal;
- obtaining, by the computing device, user feature information, based on the spectrogram or the mel-spectrogram of the sound information;
- and
- providing, by the computing device, matching information corresponding to the user feature information, to one or more of the user terminals,
- wherein the matching information comprises user-specific advertisement information,
- wherein the providing of the matching information comprises:
- generating an environmental feature table, based on one or more pieces of user feature information each corresponding to one of one or more pieces of the spectrogram or the mel-spectrogram of the sound information, that has been continuously obtained in the living space of the user in each time zone at intervals of a predetermined time period;
- and
- providing the matching information, based on the environmental feature table,
- wherein the environmental feature table comprises information on statistics of each piece of user feature information obtained at the intervals of the predetermined time period, and
- wherein the providing of the matching information further comprises:
- identifying a first point in time for providing the matching information, based on the environmental feature table, wherein the first point in time is a time point when a specific activity is performed in each time zone, and the matching information includes the user-specific advertisement information related to the specific activity;
- and
- providing the matching information at the first point in time.
A non-transitory computer-readable recording medium on which program for executing a method of providing matching information through sound information analysis in conjunction with a computing device, a user terminal, and a sensor is recorded, wherein the method comprises:
- obtaining, by the user terminal, sound information;
- generating, by the user terminal, a spectrogram or a mel-spectrogram of the sound information by analyzing of the sound information;
- identifying, by the sensor that is located in a living space of a user, whether the user is located in a specific space that is the living space of the user, by recognizing radio waves transmitted from a radio-frequency identification (RFID) module of the user terminal;
- identifying, by the computing device, whether the user is located in the specific space, based on sensing information received from the sensor;
- in response to an identification that the user is located in the specific space, obtaining, by the computing device, the spectrogram or the mel-spectrogram of the sound information from the user terminal;
- obtaining, by the computing device, user feature information, based on the spectrogram or the mel-spectrogram of the sound information;
- and
- providing, by the computing device, matching information corresponding to the user feature information, to one or more of the user terminals,
- wherein the matching information comprises user-specific advertisement information,
- wherein the providing of the matching information comprises:
- generating an environmental feature table, based on one or more pieces of user feature information each corresponding to one of one or more pieces of the spectrogram or the mel-spectrogram of the sound information, that has been continuously obtained in the living space of the user in each time zone at intervals of a predetermined time period;
- and
- providing the matching information, based on the environmental feature table,
- wherein the environmental feature table comprises information on statistics of each piece of user feature information obtained at the intervals of the predetermined time period, and
- wherein the providing of the matching information further comprises:
- identifying a first point in time for providing the matching information, based on the environmental feature table, wherein the first point in time is a time point when a specific activity is performed in each time zone, and the matching information includes the user-specific advertisement information related to the specific activity;
- and
- providing the matching information at the first point in time.
Dependencies are inferred from the claim text.