# US 2019/0318033 A1 · Remembering audio traces of physical actions

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0318033 A1
- Document ID: US20190318033A1
- Status: Published application
- Kind: A1
- Application number: 15/951,826
- Filed: 2018-04-12
- Published: 2019-10-17
- Earliest claimed: 2018-04-12
- Assignees: Microsoft Technology Licensing, LLC
- Applicants: Microsoft Technology Licensing, LLC
- Inventors: Priya Ganadas; Adolfo Hernandez Santisteban; Aaron Daniel Krauss; Andrew Frederick Muehlhausen
- Web page: https://patentgrep.com/patent/US20190318033A1

## CPC

- G06F 16/61: Indexing; Data structures therefor; Storage structures
- G06F 16/687: using geographical or spatial information, e.g. location
- G06F 16/683: using metadata automatically derived from the content
- G06F 16/686: {using information manually generated, e.g. tags, keywords, comments, title or artist information, time, location or usage information, user ratings}
- G06F 16/9535: Search customisation based on user profiles and personalisation
- G10L 25/51: for comparison or discrimination
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING

## Abstract

Methods and devices for creating a sound log of activities may include receiving a detected sound from at least one sensor on a computer device. The methods and devices may include comparing the detected sound to a plurality of audio patterns stored in a sound database. The methods and devices may include identifying a sound event for the detected sound based at least upon the comparison of the detected sound to the plurality of audio patterns. The methods and devices may include identifying context information that provides a context for the sound event. The methods and devices may include updating a sound log with the sound event and the context information.

## Claims

### Claim 1

A computer device, comprising:
a memory to store data and instructions;
a processor in communication with the memory;
an operating system in communication with the memory and the processor, wherein the operating system is operable to:
receive, from at least one sensor on the computer device, a detected sound;
compare the detected sound to a plurality of audio patterns stored in a sound database;
identify a sound event for the detected sound based at least upon the comparison of the detected sound to the plurality of audio patterns;
identify context information that provides a context for the sound event; and
update a sound log with the sound event and the context information.

### Claim 2 (depends on 1)

The computer device of claim 1, wherein the operating system is further operable to identify the sound event when a match occurs between the detected sound and at least one audio pattern of the plurality of audio patterns stored in the sound database.

### Claim 3 (depends on 1)

The computer device of claim 1, wherein the context information includes at least one or more of a location of the computer device and a time when the detected sound occurred.

### Claim 4 (depends on 1)

The computer device of claim 1, wherein the sound log provides a chronological order of a plurality of sound events and the associated context information.

### Claim 5 (depends on 1)

The computer device of claim 1, wherein the computer device further includes an assistant in communication with the memory, the processor, and the operating system, wherein the assistant is operable to:
query the sound log to provide recommendations to a user of computer device.

### Claim 6 (depends on 5)

The computer device of claim 5, wherein the assistant is further operable to:
receive a request from a user;
query the sound log based at least upon the request to identify a sound event and any the context information associated with the identified sound event; and
provide a response to the request based on the context information associated with the identified sound event.

### Claim 7 (depends on 5)

The computer device of claim 5, wherein the assistant is further operable to:
receive one or more audio patterns and the corresponding sound events; and
upload the one or more audio patterns and the corresponding sound events to the sound database.

### Claim 8 (depends on 1)

The computer device of claim 1, wherein the sound database is curated for a user of the computer device.

### Claim 9 (depends on 1)

The computer device of claim 1, wherein the at least one sensor is part of a network of sensors in communication with the computer device.

### Claim 10

A method for creating a sound log of activities, comprising:
receiving, at an operating system executing on a computer device, a detected sound from at least one sensor on the computer device;
comparing the detected sound to a plurality of audio patterns stored in a sound database;
identifying a sound event for the detected sound based at least upon the comparison of the detected sound to the plurality of audio patterns;
identifying context information that provides a context for the sound event; and
updating a sound log with the sound event and the context information.

### Claim 11 (depends on 10)

The method of claim 10, wherein identifying the sound event further comprises a match occurring between the detected sound and at least one audio pattern of the plurality of audio patterns stored in the sound database.

### Claim 12 (depends on 10)

The method of claim 10, wherein the context information includes at least one or more of a location of the computer device and a time when the detected sound occurred.

### Claim 13 (depends on 10)

The method of claim 10, wherein the sound log provides a chronological order of a plurality of sound events and the associated context information.

### Claim 14 (depends on 10)

The method of claim 10, further comprising:
querying the sound log to provide recommendations to a user of computer device.

### Claim 15 (depends on 14)

The method of claim 14, further comprising:
receiving a request from a user;
querying the sound log based at least upon the request to identify a sound event and any the context information associated with the identified sound event; and
providing a response to the request based on the context information associated with the identified sound event.

### Claim 16 (depends on 14)

The method of claim 14, further comprising:
receiving one or more audio patterns and the corresponding sound events; and
uploading the one or more audio patterns and the corresponding sound events to the sound database.

### Claim 17 (depends on 10)

The method of claim 10, wherein the sound database is curated for a user of the computer device.

### Claim 18 (depends on 10)

The method of claim 10, wherein the at least one sensor is part of a network of sensors in communication with the computer device.

### Claim 19

A computer-readable medium storing instructions executable by a computer device, comprising:
at least one instruction for causing the computer device to receive, from at least one sensor on the computer device, a detected sound;
at least one instruction for causing the computer device to compare the detected sound to a plurality of audio patterns stored in a sound database;
at least one instruction for causing the computer device to identify a sound event for the detected sound based at least upon the comparison of the detected sound to the plurality of audio patterns;
at least one instruction for causing the computer device to identify context information that provides a context for the sound event; and
at least one instruction for causing the computer device to update a sound log with the sound event and the context information.
