# US 2003/0216649 A1 · Audible output sonogram analyzer

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2003/0216649 A1
- Document ID: US20030216649A1
- Status: Published application
- Kind: A1
- Application number: 10/382,494
- Filed: 2003-03-07
- Published: 2003-11-20
- Earliest claimed: 2002-03-07
- Inventors: Mark Nowicki
- Web page: https://patentgrep.com/patent/US20030216649A1

## CPC

- G10L 21/06: Transformation of speech into a non-audible representation, e.g. speech visualisation or speech processing for tactile aids (G10L15/26 takes precedence)
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING

## Abstract

A method and apparatus for creating digital representations of sounds from printed sonograms. The method and apparatus are especially useful for audibly reproducing bird songs from printed sonograms in guidebooks to aid in the identification of birds. The apparatus is preferably conveniently sized to fit in one hand, is portable, and is capable of being used outdoors. An optical image acquisition element is used to acquire a digitized image of the printed sonogram which is then analyzed to produce a digital representation of the sound that may be stored for selective playback as an audible output and used, for example, as an aid in the identification of birds. The optical image acquisition element may be mounted within the housing or may be mounted within a separate housing. The method is also adapted for use with a pocket computer or personal digital assistant (PDA). Data logging and data transfer features are also included.

## Claims

### Claim 1

A method comprising:
a) providing a printed sonogram corresponding to a sound, the printed sonogram comprising visible strokes corresponding to the frequency and amplitude of sounds occurring at a given time;
b) optically acquiring a digitized image of the sonogram; and,
c) processing the digitized image to convert the digitized image to a digital representation of the sound.

### Claim 2 (depends on 1)

The method according to claim 1, wherein the method further comprises storing the digitized image in a memory buffer.

### Claim 3 (depends on 1)

The method according to claim 1, wherein the digitized image comprises a series of side by side columns, each column having a plurality of vertically stacked pixels, each pixel having an intensity, and wherein the digitized image is processed to determine frequency, amplitude and time data for each stroke based on the intensity of the pixels.

### Claim 4 (depends on 4)

The method according to claim 4, wherein the digitized image is processed by:
a) determining a numerical intensity value for each pixel in a first column of the series;
b) determining the presence of a columnar section of a stroke on the digitized image based on the numerical intensity value of the pixels in the column and recording time data corresponding to the lateral position of the column on the digitized image;
c) determining the midpoint of the columnar section of the stroke and recording frequency data corresponding to the height of the midpoint on the digitized image;
d) summing the numerical intensity values of each pixel in the columnar section of the stroke and recording amplitude data corresponding to the summed numerical intensity values;
e) forming a numerical list of data for the column containing the recorded frequency, time and amplitude data; and,
f) repeating steps a) to e) for each of the columns in the series and assembling the numerical list of data for each column into a digital representation of the sound.

### Claim 5 (depends on 1)

The method according to claim 1, wherein the digital representation of the sound is formatted for use with a personal computer.

### Claim 6 (depends on 1)

The method according to claim 1, wherein the method further comprises storing a plurality of digital representations of sounds in a storage location.

### Claim 7 (depends on 1)

The method according to claim 1, wherein the method further comprises generating an audible signal from the digital representation of the sound to thereby audibly reproduce the sound.

### Claim 8 (depends on 7)

The method according to claim 7, wherein the method further comprises storing a plurality of digital representations of sounds in a storage location and wherein the audible signal is generated from a digital representation of a sound selected from the storage location.

### Claim 9

An apparatus comprising:
a) a housing, the housing sized to fit in one hand;
b) an electrical power source mounted within the housing for providing electrical power to the apparatus;
c) an optical image acquisition element for optically acquiring a digitized image of a printed sonogram corresponding to a sound desired to be reproduced, the printed sonogram comprising visible strokes corresponding to the frequency and amplitude of sounds occurring at a given time; and,
d) a microprocessor mounted within the housing, the microprocessor for processing the digitized image and programmed to convert the digitized image to a digital representation of the sound.

### Claim 10 (depends on 9)

The apparatus according to claim 9, wherein the apparatus further comprises a memory element mounted within the housing, the memory element comprising a memory buffer for storing the digitized image.

### Claim 11 (depends on 9)

The apparatus according to claim 9, wherein the digitized image comprises a series of side by side columns, each column having a plurality of vertically stacked pixels, each pixel having an intensity and wherein the microprocessor is programmed to determine frequency, amplitude and time data for each stroke based on the intensity of the pixels.

### Claim 12 (depends on 11)

The apparatus according to claim 11, wherein the microprocessor is programmed to:
a) determine a numerical intensity value for each pixel in a first column of the series;
b) determine the presence of a columnar section of a stroke on the digitized image based on the numerical intensity value of the pixels in the column and record time data corresponding to the lateral position of the column on the digitized image;
c) determine the midpoint of the columnar section of the stroke and record frequency data corresponding to the height of the midpoint on the digitized image;
d) sum the numerical intensity values of each pixel in the columnar section of the stroke and record amplitude data corresponding to the summed numerical intensity values;
e) form a numerical list of data for the column containing the recorded frequency, time and amplitude data; and,
f) repeat steps a) to e) for each of the columns in the series and assemble the numerical list of data for each column into a digital representation of the sound.

### Claim 13 (depends on 9)

The apparatus according to claim 9, wherein the apparatus further comprises an audible signal generator for generating an audible signal from the digital representation of the sound to thereby reproduce the sound.

### Claim 14 (depends on 13)

The apparatus of claim 13, wherein the audible signal generator comprises a digital to analog converter, an amplifier, and an audio output transducer.

### Claim 15 (depends on 14)

The apparatus according to claim 14, wherein the audio output transducer is mounted within an ear piece.

### Claim 16 (depends on 9)

The apparatus according to claim 9, wherein the optical image acquisition element comprises a video input device, a CCD, a photodetector array, or a line scanner.

### Claim 17 (depends on 16)

The apparatus according to claim 16, wherein the optical image acquisition element is mounted within the housing.

### Claim 18 (depends on 9)

The apparatus according to claim 9, wherein the optical image acquisition element comprises a downwardly oriented uniform array of photodetectors positioned above a portion of the printed sonogram and a lens positioned between the array and the portion of the printed sonogram, the lens for focussing an optical image of the printed sonogram onto the array.

### Claim 19 (depends on 18)

The apparatus according to claim 18, wherein the distance between the lens and the array is adjustable.

### Claim 20

A method comprising:
a) making a preliminary identification of a bird based on hearing a first sound produced by the bird;
b) selecting a printed sonogram based on the preliminary identification of the bird from a book having a plurality of sonograms cross referenced with bird identities, the printed sonogram comprising visible strokes corresponding to the frequency and amplitude of sounds occurring at a given time, the printed sonogram corresponding to a second sound;
c) optically acquiring a digitized image of the sonogram;
d) storing the digitized image in a memory buffer;
e) processing the digitized image to convert the digitized image to a digital representation of the second sound;
f) generating an audible signal from the digital representation of the second sound to thereby audibly reproduce the second sound; and,
g) comparing the second sound with the first sound to confirm the preliminary identification of the bird.
