Back to results
US 10,818,282 B1Granted
Voice commands for the visually impaired to move a camera relative to a document
AssigneeUnited Services Automobile Association (USAA)
InventorHarmony Jane Clauer Salyers
Life of this patent
Estimating the term…
Abstract
A system and method for providing aural guidance in imaging a document is disclosed. Visually impaired people may have difficulty when imaging a document with a mobile computing device. The system and method may analyze the image of the document in the imaging device, and output one or more aural directions in order for the user to move the document and/or camera for proper imaging of the document. In that regard, those with visual impairments may be assisted in imaging documents using a mobile computing device.
Claims10
A method for outputting aural guidance to a visually impaired user, the method comprising:
- receiving, at a mobile computing device, a user input indicative of requesting to image a document;
- in response to receipt of the user input, a processor of the mobile computing device automatically searching for the document in part or all of a field of view of a camera associated with the mobile computing device;
- determining that the document is not at least a certain percentage of the field of view;
- responsive to determining that the document is not at least the certain percentage of the field of view:
- searching an image of the document in order to identify a number of edges for the document;
- and
- determining, based on the number of edges identified, an offset of the document relative to the camera comprising a direction to move one or both of the document or the camera so that the document is at least the certain percentage within the field of view;
- generating and transmitting, with a sound generating interface, a first aural command, based on the search for the document, that comprises one or more instructions to the user regarding a direction to move one or both of the camera and the document so that the document is at least a certain percentage of the field of view;
- determining, with the processor of the mobile computing device, after transmitting the first aural command, that the document is at least a certain percentage of the field of view;
- and
- responsive to determining that the document is at least the certain percentage of the field of view, generating and transmitting a second aural command from the sound generating interface, the second aural command comprising one or more instructions to the user to hold the camera steady;
- wherein determining the offset of the document relative to the camera comprises:
- determining a first offset of the document relative to the camera based on a first image generated by the camera;
- determining a second offset of the document relative to the camera based on a second image generated by the camera, wherein the second image is generated by the camera later in time than the first image generated by the camera;
- and
- determining a change between the first offset and the second offset.
13 more elements
A mobile apparatus to output aural guidance to a visually impaired user, the apparatus comprising:
- an image capture device;
- an input device configured to receive a user input indicative of requesting to image a document;
- an aural output device configured to output aural commands;
- and
- a controller in communication with the image capture device, the input device, and the aural output device, the controller configured to:
- in response to receipt of the user input, automatically search for the document in part or all of a field of view of image capture device;
- determine that the document is not at least a certain percentage of the field of view;
- responsive to determining that the document is not at least the certain percentage of the field of view:
- search an image of the document in order to identify a number of edges for the document;
- and
- determine, based on the number of edges identified, an offset comprising a direction to move one or both of the document or the image capture device so that the document is at least the certain percentage within the field of view;
- generate and transmit, with the aural output device, a first aural command, based on the search for the document, that comprises one or more instructions to the user regarding a direction to move one or both of the image capture device and the document so that the document is at least a certain percentage of the field of view;
- determine, after transmitting the first aural command, that the document is at least a certain percentage of the field of view;
- and
- responsive to the determining that the document is at least the certain percentage of the field of view, generate and transmit a second aural command from the aural output device, the aural command comprising one or more instructions to the user to hold the image capture device steady;
- wherein to determine the offset of the document relative to the image capture device, the controller is configured to:
- determine a first offset of the document relative to the image capture device based on a first image generated by the image capture device;
- determine a second offset of the document relative to the image capture device based on a second image generated by the image capture device, wherein the second image is generated by the image capture device later in time than the first image generated by the image capture device;
- and
- determine a change between the first offset and the second offset.
17 more elements
Dependencies are inferred from the claim text.