# US 8,787,114 B1 · Audio surveillance system > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 8,787,114 B1 - Document ID: US8787114B1 - Status: Granted - Kind: B1 - Application number: 13/036,142 - Filed: 2011-02-28 - Granted: 2014-07-22 - Earliest claimed: 2010-09-13 - Assignees: The Boeing Company - Applicants: Leonard Alan Plotke - Inventors: Leonard Alan Plotke - Web page: https://patentgrep.com/patent/US8787114B1 ## CPC - G01S 3/8083: {determining direction of source} - G01S 3/8006: {Multi-channel systems specially adapted for direction-finding, i.e. having a single aerial system capable of giving simultaneous indications of the directions of different signals} - H04N 7/188: {Capturing isolated or intermittent images triggered by the occurrence of a predetermined event, e.g. an object reaching a predetermined position (signal generation from motion picture films H04N5/253)} - G01S: RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract A method and apparatus are provided for detecting objects of interest using sounds. Sounds are monitored for using a sensor array. A number of beams are formed. Each beam in the number of beams is formed for a selected direction in which the selected direction for each beam is relative to a line of sight for the sensor array. A presence of a number of objects of interest is identified using the number of beams and the sounds detected by the sensor array. ## Claims ### Claim 1 A method for detecting objects of interest using sounds, the method comprising: monitoring for the sounds using a sensor array of a plurality of microphones arranged in a uniform hexagonal array pattern; forming a number of beams, wherein each beam in the number of beams is formed for a selected direction in which the selected direction for the each beam is relative to a line of sight for the sensor array; and identifying a presence of a number of objects of interest using the number of beams and the sounds detected by the sensor array. ### Claim 2 (depends on 1) The method of claim 1 further comprising: identifying a direction relative to the line of sight for the sensor array in which the number of objects of interest is present using the number of beams. ### Claim 3 (depends on 1) The method of claim 1, wherein the plurality of microphones being configured to generate electrical signals in response to detecting the sounds, and wherein the step of forming the number of beams comprises: identifying the selected direction for the each beam in the number of beams; and forming the each beam in the number of beams using a responsivity for each microphone in the plurality of microphones and the selected direction for the each beam, wherein the each beam in the number of beams is formed for the selected direction in which the selected direction for the each beam is relative to the line of sight for the sensor array. ### Claim 4 (depends on 3) The method of claim 3, wherein the step of forming the each beam in the number of beams using the responsivity for the each microphone in the plurality of microphones and the selected direction for the each beam, wherein the each beam in the number of beams is pointed in the selected direction in which the selected direction for the each beam is relative to the line of sight for the sensor array comprises: identifying a number of sets of time delays for the electrical signals generated by the plurality of microphones based on the selected direction for the each beam in the number of beams, wherein each set of time delays in the number of sets of time delays corresponds to a beam in the number of beams; and applying the number of sets of time delays to the electrical signals generated by the plurality of microphones. ### Claim 5 (depends on 4) The method of claim 4 further comprising: generating a number of outputs for the number of beams. ### Claim 6 (depends on 5) The method of claim 5, wherein the step of generating the number of outputs for the number of beams comprises: summing the electrical signals after a set of time delays in the number of sets of time delays corresponding to the beam in the number of beams is applied to the electrical signals to generate an output in the number of outputs for the beam. ### Claim 7 (depends on 6) The method of claim 6, wherein the step of identifying the presence of the number of objects of interest using the number of beams and the sounds detected by the sensor array comprises: identifying the presence of the number of objects of interest using the output for the each beam in the number of beams, the sounds detected by the sensor array, and a policy. ### Claim 8 (depends on 2) The method of claim 2, wherein the direction and the selected direction comprise an elevation angle and an azimuth angle relative to the line of sight for the sensor array. ### Claim 9 (depends on 1) The method of claim 1, wherein the microphones are selected from a group comprising an omnidirectional microphone, a piezoelectric microphone, a semiconductor-type microphone, and a unidirectional microphone. ### Claim 10 (depends on 1) The method of claim 1 further comprising: changing the selected direction for the each beam in the number of beams. ### Claim 11 (depends on 2) The method of claim 2 further comprising: responsive to identifying the direction relative to the line of sight for the sensor array in which the number of objects is present using the number of beams, changing the selected direction for the each beam in at least a portion of the number of beams such that the selected direction is substantially the same as the direction relative to the line of sight for the sensor array in which the number of objects is present. ### Claim 12 (depends on 2) The method of claim 2 further comprising: tracking movement of the number of objects of interest generating the sounds using the number of beams. ### Claim 13 An apparatus comprising: a sensor array configured to monitor for sounds, the sensor array including a plurality of microphones arranged in a uniform hexagonal array pattern; and a computer system associated with the sensor array and configured to form a number of beams, wherein each beam in the number of beams is formed for a selected direction in which the selected direction for the each beam is relative to a line of sight for the sensor array, and identify a presence of a number of objects of interest using the number of beams and the sounds detected by the sensor array. ### Claim 14 (depends on 13) The apparatus of claim 13, wherein the computer system is further configured to identify a direction relative to the line of sight for the sensor array in which the number of objects of interest is present using the number of beams. ### Claim 15 (depends on 13) The apparatus of claim 13, wherein the plurality of microphones being configured to generate electrical signals in response to detecting the sounds, and wherein in being configured to form the number of beams, the computer system is configured to identify the selected direction for the each beam in the number of beams; and the plurality of microphones form the each beam in the number of beams using a responsivity for each microphone in the plurality of microphones and the selected direction for the each beam, wherein the each beam in the number of beams is formed for the selected direction in which the selected direction for the each beam is relative to the line of sight for the sensor array. ### Claim 16 (depends on 15) The apparatus of claim 15, wherein in being configured to form the each beam in the number of beams using the responsivity for the each microphone in the plurality of microphones and the selected direction for the each beam, wherein the each beam in the number of beams is pointed in the selected direction in which the selected direction for the each beam is relative to the line of sight for the sensor array, the computer system is configured to identify a number of sets of time delays for the electrical signals generated by the plurality of microphones based on the selected direction for the each beam in the number of beams, wherein each set of time delays in the number of sets of time delays corresponds to a beam in the number of beams; and apply the number of sets of time delays to the electrical signals generated by the plurality of microphones. ### Claim 17 (depends on 16) The apparatus of claim 16, wherein the computer system is further configured to generate a number of outputs for the number of beams. ### Claim 18 (depends on 17) The apparatus of claim 17, wherein in being configured to generate the number of outputs for the number of beams, the computer system is configured to sum the electrical signals after a set of time delays in the number of sets of time delays corresponding to the beam in the number of beams is applied to the electrical signals to generate an output in the number of outputs for the beam. ### Claim 19 (depends on 16) The apparatus of claim 16, wherein in being configured to identify the presence of the number of objects of interest using the number of beams and the sounds detected by the sensor array, the computer system is configured to identify the presence of the number of objects of interest using the output for the each beam in the number of beams, the sounds detected by the sensor array, and a policy. ### Claim 20 (depends on 14) The apparatus of claim 14, wherein the direction and the selected direction comprise an elevation angle and an azimuth angle relative to the line of sight for the sensor array. ### Claim 21 (depends on 13) The apparatus of claim 13, wherein the computer system is further configured to change the selected direction for the each beam in the number of beams. ### Claim 22 (depends on 14) The apparatus of claim 14, wherein the computer system is further configured to responsive to identifying the direction relative to the line of sight for the sensor array in which the number of objects is present using the number of beams, change the selected direction for the each beam in at least a portion of the number of beams such that the selected direction is substantially the same as the direction relative to the line of sight for the sensor array in which the number of objects is present.