Method for recognizing multiple user actions on basis of sound information

A method of recognizing multiple user actions, the method comprising:

• collecting sounds in a place in which a user is located;
• calculating starting similarities between a starting sound pattern of the collected sounds and reference sound patterns stored in a database and ending similarities between an ending sound pattern of the collected sounds and the reference sound patterns stored in the database;
• determining starting candidate reference sound patterns, same as the starting sound pattern, from among the reference sound patterns, based on the starting similarities, and ending candidate reference sound patterns, same as the ending sound pattern, from among the reference sound patterns, based on the ending similarities;
• determining whether or not a candidate reference sound pattern from among the starting candidate reference sound patterns is same as a candidate reference sound pattern from among the ending candidate reference sound patterns;
• when the same candidate reference sound pattern is present, determining the same candidate reference sound pattern as a first final sound pattern and determining remaining final sound patterns using the first final sound pattern;
• and
• recognizing user actions mapped to the first final sound pattern and the remaining final sound patterns as multiple user actions.

A method of determining a user situation, the method comprising:

• collecting sounds and user location information in a place in which a user is located;
• calculating starting similarities between a starting sound pattern of the collected sounds and reference sound patterns stored in a database and ending similarities between an ending sound pattern of the collected sounds and the reference sound patterns stored in the database;
• selecting starting candidate reference sound patterns and ending candidate reference sound patterns, same as the starting sound pattern and the ending sound pattern, from among the reference sound patterns, based on the starting similarities and the ending similarities;
• determining a first final sound pattern and a second final sound pattern, producing the collected sounds, from among the starting candidate reference sound patterns or the ending candidate reference sound patterns, by comparing combined sound patterns, produced from the starting candidate reference sound patterns and the ending candidate reference sound patterns, with the collected sounds;
• and
• determining a user situation based on a combination of sound patterns, produced from the first final sound pattern and the second final sound pattern, and the user location information.