# US 10,482,901 B1 · System and method for beep detection and interpretation > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,482,901 B1 - Document ID: US10482901B1 - Status: Granted - Kind: B1 - Application number: 16/147,333 - Filed: 2018-09-28 - Granted: 2019-11-19 - Earliest claimed: 2017-09-28 - Assignees: Alarm.com Incorporated - Applicants: Alarm.com Incorporated - Inventors: Kevin Maurer; Alison Jane Slavin; Innocent Djiofack; Stephen Trundle - Web page: https://patentgrep.com/patent/US10482901B1 ## CPC - G10L 25/51: for comparison or discrimination - G06N 3/045: Combinations of networks - G06N 3/0499: Feedforward networks - G06N 3/08: Learning methods - G06N 3/09: Supervised learning - H04R 29/00: Monitoring arrangements; Testing arrangements {(for hearing aids H04R25/30; detection of loudspeaker connection H04R5/04; sound-field adaptation dependent on speaker detection H04S7/308)} - H04R 3/005: {for combining the signals of two or more microphones (specially adapted for hearing aids H04R25/407)} - G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING - G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS - H04R: LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS (producing sounds with frequency not determined by supply frequency G10K) ## Abstract Methods, systems, and apparatus, including computer programs encoded on a storage device, for beep detection and interpretation is disclosed. In one aspect, a monitoring system is disclosed that includes a processor and a storage device storing instructions that, when executed by the processor, causes the processor to perform operations. The operations may include obtaining sound data of audio sounds detected by a microphone that is located at the property, determining whether the sound data includes data representing one or more audio tones generated by a device, based on determining that the obtained sound data includes one or more audio tones generated by a device, generating an audio fingerprint of the sound data, determining, using the generated audio fingerprint, a state of the device that generated the one or more audio tones, and performing an operation based on the state of the device that generated the one or more audio tones. ## Claims ### Claim 1 A monitoring system for monitoring a property, the monitoring system comprising: one or more processors; and one or more storage devices, the one or more storage devices storing instructions that, when executed by the one or more processors, cause the one or more processors to perform operations comprising: obtaining, by the monitoring system, sound data of audio sounds detected by a microphone that is located at the property; determining, by the monitoring system, whether the sound data includes data representing one or more audio tones generated by a device; based on determining that the obtained sound data includes one or more audio tones generated by a device, generating, by the monitoring system, an audio fingerprint of the sound data; generating, by the monitoring system, a query that includes the generated audio fingerprint as a search parameter; obtaining, by the monitoring system and in response to the generated query, (i) a device identifier of the device that generated the one or more audio tones and (ii) a state of the device that generated the one or more audio tones; and performing, by the monitoring system, one or more operations based on at least one of the device identifier and the state of the device that generated the one or more audio tones. ### Claim 2 (depends on 1) The monitoring system of claim 1, the operations further comprising: extracting, by the monitoring system, the one or more audio tones from the sound data. ### Claim 3 (depends on 2) The monitoring system of claim 2, wherein generating, by the monitoring system, an audio fingerprint, of the sound data, comprises: generating, by the monitoring system, the audio fingerprint based on one or more of (i) a frequency or pattern of the one or more extracted audio tones, (ii) a loudness of the one or more extracted audio tones, (iii) a duration of each of the one or more extracted audio tones, (iv) a pattern of the one or more extracted audio tones, or (v) a duration and pattern of the one or more extracted audio tones in the obtained sound data. ### Claim 4 (depends on 1) The monitoring system of claim 1, the operations further comprising: obtaining, by the monitoring system, second sound data of audio sounds detected by a microphone that is located at the property; determining, by the monitoring system, that the obtained second sound data does not include one or more audio tones generated by a device; based on determining, by the monitoring system, that the obtained second sound data does not include one or more audio tones generated by a device, obtaining, by the monitoring system, additional sound data of audio sounds detected by the microphone that is located at the property; and determining, by the monitoring system and based on the additional sound data, whether the additional sound data includes one or more audio tones generated by a device. ### Claim 5 (depends on 1) The monitoring system of claim 1, wherein obtaining sound data of audio sounds detected by a microphone that is located at the property comprises recording, using the microphone, audio sounds at the property. ### Claim 6 (depends on 1) The monitoring system of claim 1, wherein obtaining sound data of audio sounds detected by a microphone located at the property comprises receiving, by the monitoring system, a recording of audio sounds that occurred at the property. ### Claim 7 (depends on 1) The monitoring system of claim 1, wherein determining, by the monitoring system, whether the sound data includes data representing one or more audio tones comprises: providing, by the monitoring system, the sound data as an input to a machine learning model that has been trained to determine whether sound data includes one or more audio tones generated by a device; receiving, by the monitoring system, an output from the machine learning model that indicates whether the detected sound data includes the one or more audio tones generated by the device; and determining, by the monitoring system and based on the received output from the machine learning model, whether the sound data includes the one or more audio tones generated the device. ### Claim 8 (depends on 1) The monitoring system of claim 1, the operations further comprising: determining, by the monitoring system, a particular operation to perform based on (i) the device identifier and (ii) the state of the device; and wherein performing one or more operations, by the monitoring system, based on at least one of the device identifier and the state of the device that generated the one or more audio tones comprises: transmitting, by the monitoring system, a notification that prompts the user to perform the particular operation. ### Claim 9 (depends on 1) The monitoring system of claim 1, the operations further comprising: determining, by the monitoring system, a particular operation to perform based on (i) the device identifier and (ii) the state of the device; and wherein performing one or more operations, by the monitoring system, based on at least one of the device identifier and the state of the device that generated the one or more audio tones comprises: transmitting, by the monitoring system, an instruction to a component of the monitoring system to perform the particular operation. ### Claim 10 (depends on 1) The monitoring system of claim 1, wherein determining, by the monitoring system, whether the sound data includes data representing one or more audio tones generated by a device comprises: determining, by the monitoring system, whether the sound data includes data representing one or more audio tones generated by a speaker of the device. ### Claim 11 A method for monitoring a property, the method comprising: obtaining, by the monitoring system, sound data of audio sounds detected by a microphone that is located at the property; determining, by the monitoring system, whether the sound data includes data representing one or more audio tones generated by a device; based on determining that the obtained sound data includes one or more audio tones generated by a device, generating, by the monitoring system, an audio fingerprint of the sound data; generating, by the monitoring system, a query that includes the generated audio fingerprint as a search parameter; obtaining, by the monitoring system and in response to the generated query, (i) a device identifier of the device that generated the one or more audio tones and (ii) a state of the device that generated the one or more audio tones; and performing, by the monitoring system, one or more operations based on at least one of the device identifier and the state of the device that generated the one or more audio tones. ### Claim 12 (depends on 11) The method of claim 11, the method further comprising: extracting, by the monitoring system, the one or more audio tones from the sound data. ### Claim 13 (depends on 12) The method of claim 12, wherein generating, by the monitoring system, an audio fingerprint, of the sound data, comprises: generating, by the monitoring system, the audio fingerprint based on one or more of (i) a frequency or pattern of the one or more extracted audio tones, (ii) a loudness of the one or more extracted audio tones, (iii) a duration of each of the one or more extracted audio tones, (iv) a pattern of the one or more extracted audio tones, or (v) a duration and pattern of the one or more extracted audio tones in the obtained sound data. ### Claim 14 (depends on 11) The method of claim 11, the method further comprising: obtaining, by the monitoring system, second sound data of audio sounds detected by a microphone that is located at the property; determining, by the monitoring system, that the obtained second sound data does not include one or more audio tones generated by a device; based on determining, by the monitoring system, that the obtained second sound data does not include one or more audio tones generated by a device, obtaining, by the monitoring system, additional sound data of audio sounds detected by the microphone that is located at the property; and determining, by the monitoring system and based on the additional sound data, whether the additional sound data includes one or more audio tones generated by a device. ### Claim 15 (depends on 11) The method of claim 11, wherein obtaining sound data of audio sounds detected by a microphone that is located at the property comprises recording, using the microphone, audio sounds at the property. ### Claim 16 (depends on 11) The method of claim 11, wherein obtaining sound data of audio sounds detected by a microphone located at the property comprises receiving, by the monitoring system, a recording of audio sounds that occurred at the property. ### Claim 17 (depends on 11) The method of claim 11, wherein determining, by the monitoring system, whether the sound data includes data representing one or more audio tones comprises: providing, by the monitoring system, the sound data as an input to a machine learning model that has been trained to determine whether sound data includes one or more audio tones generated by a device; receiving, by the monitoring system, an output from the machine learning model that indicates whether the detected sound data includes the one or more audio tones generated by the device; and determining, by the monitoring system and based on the received output from the machine learning model, whether the sound data includes the one or more audio tones generated the device. ### Claim 18 (depends on 11) The method of claim 11, the method further comprising: determining, by the monitoring system, a particular operation to perform based on (i) the device identifier and (ii) the state of the device; and wherein performing one or more operations, by the monitoring system, based on at least one of the device identifier and the state of the device that generated the one or more audio tones comprises: transmitting, by the monitoring system, a notification that prompts the user to perform the particular operation. ### Claim 19 (depends on 11) The method of claim 11, the method further comprising: determining, by the monitoring system, a particular operation to perform based on (i) the device identifier and (ii) the state of the device; and wherein performing one or more operations, by the monitoring system, based on at least one of the device identifier and the state of the device that generated the one or more audio tones comprises: transmitting, by the monitoring system, an instruction to a component of the monitoring system to perform the particular operation. ### Claim 20 (depends on 11) The method of claim 11, wherein determining, by the monitoring system, whether the sound data includes data representing one or more audio tones generated by a device comprises: determining, by the monitoring system, whether the sound data includes data representing one or more audio tones generated by a speaker of the device.