# US 2010/0169754 A1 · Attaching Audio Generated Scripts to Graphical Representations of Applications > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2010/0169754 A1 - Document ID: US20100169754A1 - Status: Published application - Kind: A1 - Application number: 12/346,999 - Filed: 2008-12-31 - Published: 2010-07-01 - Earliest claimed: 2008-12-31 - Assignees: International Business Machines Corporation - Inventors: Lloyd W. Allen, JR.; Jana Helton Jenkins; Steven Michael Miller - Web page: https://patentgrep.com/patent/US20100169754A1 ## CPC - G06F 40/169: Annotation, e.g. comment data or footnotes - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) ## Abstract A computer implemented method, a computer program product, and a data processing system attach audio generated scripts to graphical representations of applications. A mobile device records an audio instruction. The mobile device then converts the audio instruction into a command script and associates the command script with a document identifier. The mobile device then forwards the document identifier and the associated command script to a target location. The command script can then be utilized at the target location to make changes to a document identified by the document identifier. ## Claims ### Claim 1 A computer implemented method for attaching audio generated scripts to graphical representations of applications, the computer implemented method comprising: recording an audio instruction; converting the audio instruction into a command script; associating the command script with a document identifier; forwarding the document identifier and the associated command script to a target location. ### Claim 2 (depends on 1) The computer implemented method of claim 1 further comprising: receiving an indication that a change should be made to the document; and creating the document identifier. ### Claim 3 (depends on 2) The computer implemented method of claim 2, wherein the indication is selected from the group consisting of an alphanumeric text based indication and an audio indication. ### Claim 4 (depends on 1) The computer implemented method of claim 1, wherein the document identifier indicates a network address of the document. ### Claim 5 (depends on 1) The computer implemented method of claim 1, wherein the audio instructions are a sound file selected from the group consisting of a .wav file, a .raw file, a .ogg file, a .mp3 file, a .mp4 file, a .ra file, a .mpa file, a .mpc file, an .aiff file, an .au file, a .gsm file, a .dct file, a .vox file, an .aac file, a .wma file, a .msv file, and a .dvf file. ### Claim 6 (depends on 1) The computer implemented method of claim 1, wherein the step of converting the audio instruction into a command script further comprises: dividing the audio instructions into frames; creating a spectral representation of the frames; isolating characteristics from the spectral representation; comparing the isolated characteristics to a statistical model, wherein the comparing utilizes a method selected from the group consisting of K-nearest neighbor, Gaussian mixture modeling, support vector machines, vector quantization, hidden Markov modeling, and multivariate auto-regression modeling; and determining a probable text; and converting the probable text into the command script. ### Claim 7 (depends on 1) The computer implemented method of claim 1 further comprising: receiving the document identifier and the associated command script at a data processing system, wherein the data processing system includes the target location; locating a document at the target location, wherein the document identifier indicates the document; and making changes to the document according to the command script. ### Claim 8 A computer-readable medium having a computer program product encoded thereon for attaching audio generated scripts to graphical representations of applications, the computer-readable medium having a computer program product encoded thereon comprising: computer usable program code for recording an audio instruction; computer usable program code, for converting the audio instruction into a command script; computer usable program code, for associating the command script with a document identifier; and computer usable program code for forwarding the document identifier and the associated command script to a target location. ### Claim 9 (depends on 8) The computer-readable medium method of claim 8 further comprising: computer usable program code for receiving an indication that a change should be made to the document; and computer usable program code, creating the document identifier. ### Claim 10 (depends on 9) The computer-readable medium of claim 9, wherein the indication is selected from the group consisting of an alphanumeric text based indication and an audio indication. ### Claim 11 (depends on 8) The computer-readable medium of claim 8, wherein the document identifier indicates a network address of the document. ### Claim 12 (depends on 8) The computer-readable medium of claim 8, wherein the audio instructions are a sound file selected from the group consisting of a .wav file, a .raw file, a .ogg file, a .mp3 file, a .mp4 file, a .ra file, a .mpa file, a .mpc file, an .aiff file, an .au file, a .gsm file, a .dct file, a .vox file, an .aac file, a .wma file, a .msv file, and a .dvf file. ### Claim 13 (depends on 8) The computer-readable medium of claim 8, wherein the computer usable program code for converting the audio instruction into a command script further comprises: computer usable program code for dividing the audio instructions into frames; creating a spectral representation of the frames; computer usable program code, for isolating characteristics from the spectral representation; computer usable program code, for comparing the isolated characteristics to a statistical model, wherein the comparing utilizes a method selected from the group consisting of K-nearest neighbor, Gaussian mixture modeling, support vector machines, vector quantization, hidden Markov modeling, and multivariate auto-regression modeling; and computer usable program code, for determining a probable text; and computer usable program code for converting the probable text into the command script. ### Claim 14 (depends on 8) The computer-readable medium of claim 8 further comprising: computer usable program code for receiving the document identifier and the associated command script at a data processing system, wherein the data processing system includes the target location; computer usable program code, for locating a document at the target location, wherein the document identifier indicates the document; and making changes to the document according to the command script. ### Claim 15 A data processing system comprising: a bus; a communications unit connected to the bus; a storage device connected to the bus, wherein the storage device includes computer usable program code for attaching audio generated scripts to graphical representations of applications; and a processor unit connected to the bus, wherein the processor unit executes the computer usable program code to record an audio instruction; to convert the audio instruction into a command script; to associate the command script with a document identifier; and to forward the document identifier and the associated command script to a target location. ### Claim 16 (depends on 15) The data processing system of claim 15, wherein the processor unit further executes the computer usable program code to receive an indication that a change should be made to the document; and to create the document identifier. ### Claim 17 (depends on 16) The data processing system of claim 16, wherein the indication is selected from the group consisting of an alphanumeric text based indication and an audio indication. ### Claim 18 (depends on 15) The data processing system of claim 15, wherein the document identifier indicates a network address of the document. ### Claim 19 (depends on 15) The data processing system of claim 15, wherein the audio instructions are a sound file selected from the group consisting of a .wav file, a .raw file, a .ogg file, a .mp3 file, a .mp4 file, a .ra file, a .mpa file, a .mpc file, an .aiff file, an .au file, a .gsm file, a .dct file, a .vox file, an .aac file, a .wma file, a .msv file, and a .dvf file. ### Claim 20 (depends on 15) The data processing system of claim 15, wherein the processor unit executing the computer usable program code to convert the audio instruction into a command script further comprises the processor unit further executing the computer usable program code to dividing the audio instructions into frames, to create a spectral representation of the frames; to isolate characteristics from the spectral representation; to compare the isolated characteristics to a statistical model, wherein the comparing utilizes a method selected from the group consisting of K-nearest neighbor, Gaussian mixture modeling, support vector machines, vector quantization, hidden Markov modeling, and multivariate auto-regression modeling; to determine a probable text; and to convert the probable text into the command script.