Back to results
US 12,002,449 B1Granted
Voice commands for the visually impaired
AssigneeUnited Services Automobile Association (USAA)
InventorHarmony Jane Clauer Salyers
Life of this patent
Estimating the term…
Abstract
A system and method for providing aural guidance in imaging a document is disclosed. Visually impaired people may have difficulty when imaging a document with a mobile computing device. The system and method may analyze the image of the document in the imaging device, and output one or more aural directions in order for the user to move the document and/or camera for proper imaging of the document. In that regard, those with visual impairments may be assisted in imaging documents using a mobile computing device.
Claims16
A method for outputting aural guidance to a visually impaired user, the method comprising:
- automatically searching, with a processor of a mobile computing device, for a document in part or all of a field of view of an imaging device associated with the mobile computing device;
- determining, with the processor of the mobile computing device, that at least a portion of the document is a certain amount and direction outside of the field of view;
- responsive to determining that at least a portion of the document is a certain amount and direction outside the field of view, generating and transmitting, with the processor of the mobile computing device, a first aural command from a sound generating interface, the first aural command comprising instructions for movement of the imaging device or document in at least one direction and a relative magnitude of the movement in the at least one direction;
- determining, with the processor of the mobile computing device, that the document is at least a certain percentage of the field of view;
- and
- responsive to determining that the document is at least a certain percentage of the field of view:
- generating and transmitting, with the processor of the mobile computing device, a second aural command from the sound generating interface comprising a command to hold the imaging device steady;
- and
- automatically generating an image of the document with the imaging device;
- determining, with the processor, that that document is not at least the certain percentage of the field of view;
- responsive to determining that the document is not at least the certain percentage of the field of view:
- searching, with the processor, the image of the document and identifying, with the processor, a number of edges for the document;
- and
- determining, with the processor, based on the number of edges identified, an offset comprising a direction to move one or both of the document or the imaging device so that the document is at least the certain percentage within the field of view, wherein determining the offset comprises:
- determining, with the processor, a first offset of the document relative to the imaging device based on a first image generated by the imaging device;
- determining, with the processor, a second offset of the document relative to the imaging device based on a second image generated by the imaging device, wherein the second image is generated by the imaging device later in time than the first image generated by the imaging device;
- and
- determining, with the processor, a change between the first offset and the second offset.
15 more elements
A mobile apparatus to output aural guidance to a visually impaired user, the apparatus comprising:
- an imaging device;
- an aural output device configured to output aural commands;
- and
- a processor in communication with the imaging device and the aural output device, the processor configured to:
- automatically search for a document in part or all of a field of view of the imaging device;
- determine that at least a portion of the document is a certain amount and direction outside of the field of view;
- responsive to determining that at least a portion of the document is a certain amount and direction outside the field of view, generate and transmit a first aural command from the aural output device, the first aural command comprising instructions for movement of the imaging device or document in at least one direction and a relative magnitude of the movement in the at least one direction;
- determine that the document is at least a certain percentage of the field of view;
- and
- responsive to determining that the document is at least a certain percentage of the field of view:
- generate and transmit a second aural command from the aural output device comprising a command to hold the camera steady;
- and
- automatically capturing an image of the document with the imaging device;
- determine that that document is not at least the certain percentage of the field of view;
- responsive to determining that the document is not at least the certain percentage of the field of view:
- search the image of the document and identify a number of edges for the document;
- and
- determine, based on the number of edges identified, an offset comprising a direction to move one or both of the document or the imaging device so that the document is at least the certain percentage within the field of view, wherein determining the offset comprises:
- determine a first offset of the document relative to the imaging device based on a first image generated by the imaging device;
- determine a second offset of the document relative to the imaging device based on a second image generated by the imaging device, wherein the second image is generated by the imaging device later in time than the first image generated by the imaging device;
- and
- determine a change between the first offset and the second offset.
19 more elements
Dependencies are inferred from the claim text.