# US 12,002,449 B1 · Voice commands for the visually impaired > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,002,449 B1 - Document ID: US12002449B1 - Status: Granted - Kind: B1 - Application number: 17/846,326 - Filed: 2022-06-22 - Granted: 2024-06-04 - Earliest claimed: 2016-01-22 - Assignees: United Services Automobile Association (USAA) - Applicants: United Services Automobile Association (USAA) - Inventors: Harmony Jane Clauer Salyers - Web page: https://patentgrep.com/patent/US12002449B1 ## CPC - G10L 13/00: Speech synthesis; Text to speech systems - G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback} - G09B 21/006: {using audible presentation of the information} - H04N 5/2222: {Prompting} - H04N 23/62: Control of parameters via user interfaces - H04N 23/633: {for displaying additional information relating to control or operation of the camera} - H04N 23/64: {Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image} - G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G09B: EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS (devices for psychotechnics or for testing reaction times A61B5/16; games, sports, amusements A63; projectors, projector screens G03B) - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract A system and method for providing aural guidance in imaging a document is disclosed. Visually impaired people may have difficulty when imaging a document with a mobile computing device. The system and method may analyze the image of the document in the imaging device, and output one or more aural directions in order for the user to move the document and/or camera for proper imaging of the document. In that regard, those with visual impairments may be assisted in imaging documents using a mobile computing device. ## Claims ### Claim 1 A method for outputting aural guidance to a visually impaired user, the method comprising: automatically searching, with a processor of a mobile computing device, for a document in part or all of a field of view of an imaging device associated with the mobile computing device; determining, with the processor of the mobile computing device, that at least a portion of the document is a certain amount and direction outside of the field of view; responsive to determining that at least a portion of the document is a certain amount and direction outside the field of view, generating and transmitting, with the processor of the mobile computing device, a first aural command from a sound generating interface, the first aural command comprising instructions for movement of the imaging device or document in at least one direction and a relative magnitude of the movement in the at least one direction; determining, with the processor of the mobile computing device, that the document is at least a certain percentage of the field of view; and responsive to determining that the document is at least a certain percentage of the field of view: generating and transmitting, with the processor of the mobile computing device, a second aural command from the sound generating interface comprising a command to hold the imaging device steady; and automatically generating an image of the document with the imaging device; determining, with the processor, that that document is not at least the certain percentage of the field of view; responsive to determining that the document is not at least the certain percentage of the field of view: searching, with the processor, the image of the document and identifying, with the processor, a number of edges for the document; and determining, with the processor, based on the number of edges identified, an offset comprising a direction to move one or both of the document or the imaging device so that the document is at least the certain percentage within the field of view, wherein determining the offset comprises: determining, with the processor, a first offset of the document relative to the imaging device based on a first image generated by the imaging device; determining, with the processor, a second offset of the document relative to the imaging device based on a second image generated by the imaging device, wherein the second image is generated by the imaging device later in time than the first image generated by the imaging device; and determining, with the processor, a change between the first offset and the second offset. ### Claim 2 (depends on 1) The method of claim 1, wherein the image of the document is generated after the second aural command. ### Claim 3 (depends on 1) The method of claim 1, wherein the image of the document is captured concurrently with generating and transmitting the second aural command. ### Claim 4 (depends on 1) The method of claim 1, wherein the document comprises a negotiable instrument. ### Claim 5 (depends on 1) The method of claim 1, wherein the one or more commands of the first aural command comprise instructions to the user regarding a direction to move one or both of the imaging device and the document so that the document is at least a certain percentage of the field of view. ### Claim 6 (depends on 5) The method of claim 5, wherein the one or more commands of the first aural command comprise instructions to move the imaging device closer to or further away from the document. ### Claim 7 (depends on 1) The method of claim 1, further comprising: transmitting, with the processor, the image of the check to an external server. ### Claim 8 (depends on 1) The method of claim 1, wherein the mobile computing device is a cellular phone. ### Claim 9 A mobile apparatus to output aural guidance to a visually impaired user, the apparatus comprising: an imaging device; an aural output device configured to output aural commands; and a processor in communication with the imaging device and the aural output device, the processor configured to: automatically search for a document in part or all of a field of view of the imaging device; determine that at least a portion of the document is a certain amount and direction outside of the field of view; responsive to determining that at least a portion of the document is a certain amount and direction outside the field of view, generate and transmit a first aural command from the aural output device, the first aural command comprising instructions for movement of the imaging device or document in at least one direction and a relative magnitude of the movement in the at least one direction; determine that the document is at least a certain percentage of the field of view; and responsive to determining that the document is at least a certain percentage of the field of view: generate and transmit a second aural command from the aural output device comprising a command to hold the camera steady; and automatically capturing an image of the document with the imaging device; determine that that document is not at least the certain percentage of the field of view; responsive to determining that the document is not at least the certain percentage of the field of view: search the image of the document and identify a number of edges for the document; and determine, based on the number of edges identified, an offset comprising a direction to move one or both of the document or the imaging device so that the document is at least the certain percentage within the field of view, wherein determining the offset comprises: determine a first offset of the document relative to the imaging device based on a first image generated by the imaging device; determine a second offset of the document relative to the imaging device based on a second image generated by the imaging device, wherein the second image is generated by the imaging device later in time than the first image generated by the imaging device; and determine a change between the first offset and the second offset. ### Claim 10 (depends on 9) The mobile apparatus of claim 9, wherein the image of the document is captured after the second aural command. ### Claim 11 (depends on 9) The mobile apparatus of claim 9, wherein the image of the document is captured concurrently with generation and transmission of the second aural command. ### Claim 12 (depends on 9) The mobile apparatus of claim 9, wherein the document comprises a negotiable instrument. ### Claim 13 (depends on 9) The mobile apparatus of claim 9, wherein the one or more commands of the first aural command comprise instructions to the user regarding a direction to move one or both of the imaging device and the document so that the document is at least a certain percentage of the field of view. ### Claim 14 (depends on 13) The mobile apparatus of claim 13, wherein the one or more commands of the first aural command comprise instructions to move the camera closer to or further away from the document. ### Claim 15 (depends on 9) The mobile apparatus of claim 9, wherein the processor is further configured to: transmit the image of the check to an external server. ### Claim 16 (depends on 9) The mobile apparatus of claim 9, wherein the mobile apparatus is a cellular phone.