# US 2023/0056834 A1 · Navigational assistance for the visually impaired

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0056834 A1
- Document ID: US20230056834A1
- Status: Published application
- Kind: A1
- Application number: 17/409,498
- Filed: 2021-08-23
- Published: 2023-02-23
- Earliest claimed: 2021-08-23
- Assignees: Micron Technology, Inc.
- Applicants: Micron Technology, Inc.
- Inventors: Vijay S. Ramesh
- Web page: https://patentgrep.com/patent/US20230056834A1

## CPC

- G06F 9/5016: {the resource being the memory}
- G01C 21/3415: {Dynamic re-routing, e.g. recalculating the route when the user deviates from calculated route or after detecting real-time traffic data or accidents}
- G06V 10/955: {using specific electronic processors}
- G06V 10/98: Detection or correction of errors, e.g. by rescanning the pattern or by human intervention; Evaluation of the quality of the acquired patterns
- G06V 20/20: in augmented reality scenes
- G08B 6/00: Tactile signalling systems, e.g. tactile personal calling systems
- G08B 21/0476: {Cameras to detect unsafe condition, e.g. video cameras}
- G09B 21/003: {using tactile presentation of the information, e.g. Braille displays}
- G09B 21/006: {using audible presentation of the information}
- G09B 21/007: {using both tactile and audible presentation of the information}
- G06F 2209/501: Performance criteria
- G06F 2209/5017: Task decomposition
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G01C: MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY (measuring liquid level G01F; radio navigation, determining distance or velocity by use of propagation effects, e.g. Doppler effects, propagation time, of radio waves, analogous arrangements using other waves G01S)
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G08B: SIGNALLING SYSTEMS, e.g. PERSONAL CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G09B: EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS (devices for psychotechnics or for testing reaction times A61B5/16; games, sports, amusements A63; projectors, projector screens G03B)

## Abstract

A method for navigational assistance for the visually impaired can include determining that an image captured by an imaging device contains an unknown object and determining that the unknown object is not resolvable within a threshold period of time. The method can further include performing an operation to reallocate computing resources between memory devices couplable to the imagining device in response to determining that the unknown object is not resolvable within the threshold period of time. Data corresponding to the unknown object can be written to the reallocated computing resources and an operation involving the data corresponding to the unknown object can be performed to resolve the unknown object using the reallocated computing resources.

## Claims

### Claim 1

A method, comprising:
determining, by a processor coupled to a first memory device comprising a first type of media and a second memory device comprising a second type of media, that an image captured by an imaging device coupled to the processor contains an unknown object;
determining, based at least in part on an object recognition model executed by the processor, that at least a portion of the unknown object represents an object to be resolved that is not resolvable within a threshold period of time;
performing an operation to reallocate computing resources between the first memory device and the second memory device in response to determining that the unknown object is not resolvable within the threshold period of time;
writing, by the processor, at least a portion of data associated with the unknown object to the reallocated resources of the first memory device or the second memory device, or both; and
performing, using the reallocated computing resources, an operation involving the data corresponding to the unknown object to resolve the unknown obj ect.

### Claim 2 (depends on 1)

The method of claim 1, further comprising determining, based at least in part on a determined confidence level associated with the image, that the unknown object is not resolvable within the threshold period of time.

### Claim 3 (depends on 1)

The method of claim 1, further comprising determining that the first memory device or the second memory device has a higher bandwidth than the other of the first memory device or the second memory device, wherein
the operation to reallocate computing resources between the first memory device and the second memory device comprises reallocating the computing resources such that greater than a threshold amount of memory that has the higher bandwidth is available to perform the operation to resolve the unknown obj ect.

### Claim 4 (depends on 1)

The method of claim 1, further comprising determining that the first memory device or the second memory device has a faster memory access time than the other of the first memory device or the second memory device, wherein
the operation to reallocate computing resources between the first memory device and the second memory device comprises reallocating the computing resources such that greater than a threshold amount of memory that has the faster memory access time is available to perform the operation to resolve the unknown object.

### Claim 5 (depends on 1)

The method of claim 1, wherein the processor, the first memory device, and the second memory device are resident on a mobile computing device, and wherein the method further comprises:
determining that the unknown object presents an impending danger to a user of the mobile computing device; and
updating route information associated with the mobile computing device to route the user of the mobile computing device away from the unknown object.

### Claim 6 (depends on 1)

The method of claim 1, wherein the processor, the first memory device, and the second memory device are resident on a mobile computing device, and wherein the method further comprises:
determining that the unknown object cannot be resolved within a threshold period of time corresponding to a user of the mobile computing device coming into contact with the unknown object; and
updating route information associated with the mobile computing device to route the user of the mobile computing device away from the unknown object.

### Claim 7 (depends on 1)

The method of claim 1, further comprising:
determining that the processor is receiving network coverage from a first base station;
determining that the processor has moved to a different geographical location and is receiving network coverage from a second base station; and
performing the operation to reallocate computing resources between the first memory device and the second memory device in response to determining that the processor is receiving network coverage from the second base station.

### Claim 8 (depends on 1)

The method of claim 1, further comprising generating vibrational patterns corresponding to navigation in the presence of the unknown object or voice-assisted navigation updates corresponding to navigation in the presence of the unknown object, or both.

### Claim 9

An apparatus, comprising:
a first memory device comprising a first type of media;
a second memory device comprising a second type of media; and
a processor coupled to the first memory device and the second memory device, wherein the processor is to:
determine that an image captured by an imaging device coupled to the processor contains an unknown object;
determine, based at least in part on a determined confidence level associated with the image, that the unknown object is not resolvable within a threshold period of time;
perform an operation to reallocate computing resources between the first memory device and the second memory device in response to determining that the unknown object is not resolvable within the threshold period of time;
write at least a portion of data associated with the unknown object to the reallocated resources of the first memory device or the second memory device, or both; and
perform, using the reallocated computing resources, an operation involving the data corresponding to the unknown object to resolve the unknown obj ect.

### Claim 10 (depends on 9)

The apparatus of claim 9, wherein the processor is to determine, based at least in part on an object recognition model executed by the processor, that the unknown object is not resolvable within the threshold period of time.

### Claim 11 (depends on 9)

The apparatus of claim 9, wherein the first type of media and the second type of media each comprise sets of memory cells that exhibit different storage characteristics.

### Claim 12 (depends on 9)

The apparatus of claim 9, wherein:
the first memory device or the second memory device is a non-persistent memory device, and
the other of the first memory device or the second memory device is a persistent memory device.

### Claim 13 (depends on 9)

The apparatus of claim 9, wherein:
the first memory device or the second memory device is a NAND flash memory device that comprises a set of single level memory cells (SLCs) and a set of multi-level memory cells (MLCs), and
the processor is to write the data corresponding to the unknown object to the set of SLC memory cells as part of the operation to resolve the unknown object.

### Claim 14 (depends on 9)

The apparatus of claim 9, wherein the processor, the first memory device, and the second memory device are resident on a mobile computing device, and wherein the processor is to:
determine that the mobile computing device has experienced a handoff from a first base station to a second base station; and
perform the operation to reallocate computing resources between the first memory device and the second memory device responsive to the determination that the mobile computing device has experienced the handoff.

### Claim 15 (depends on 9)

The apparatus of claim 9, wherein the processor, the first memory device, and the second memory device are resident on a mobile computing device, and wherein the processor is to:
determine that the unknown object presents an impending danger to a user of the mobile computing device or determine that the unknown object cannot be resolved within a threshold period of time corresponding to the user coming into contact with the unknown object, or both; and
update route information associated with the mobile computing device to route the user of the mobile computing device away from the unknown object.

### Claim 16 (depends on 9)

The apparatus of claim 9, wherein the processor is to execute instructions corresponding to one or more machine learning operations as part of performance of the operation involving the data corresponding to the unknown object to resolve the unknown object.

### Claim 17

A system, comprising:
a mobile computing device coupled to the imaging device and comprising a processor, a first memory device, a second memory device, and a third memory device; and
an imaging device resident on the mobile computing device, wherein the processor is to:
receive an image captured by an imaging device coupled to the processor that contains greater than a threshold quantity of unidentifiable pixels;
classify the captured image as an image that contains an unknown object based on the image containing greater than the threshold quantity of unidentifiable pixels;
determine that at least a portion of the of unidentifiable pixels are not resolvable within a first threshold period of time, based at least in part, on an object recognition model executed by the processor or a determined confidence level associated with the captured image, or both;
determine that the unknown object presents an impending danger to a user of the mobile computing device;
reallocate computing resources amongst the first memory device, the second memory device, or the third memory device, or any combination thereof in response to the determination that at least the portion of the unidentifiable pixels are not resolvable within the first threshold period of time or the determination that the unknown object presents an impending danger to the user of the mobile computing device, or both;
perform, using the reallocated computing resources, an operation involving at least the portion of the unidentifiable pixels corresponding to the unknown object to resolve the unknown object; and
determine, within a second threshold period of time, whether the operation to resolve the unknown object is successful.

### Claim 18 (depends on 17)

The system of claim 17, wherein the processor is to notify the user of the mobile computing device that the unknown object is resolved in response to a determination that the operation to resolve the unknown object is successful within the second threshold period of time.

### Claim 19 (depends on 17)

The system of claim 17, wherein the processor is to update route information associated with the mobile computing device to route the user of the mobile computing device away from the unknown object in response to a determination that the operation to resolve the unknown object is unsuccessful withing the second threshold period of time.

### Claim 20 (depends on 17)

The system of claim 17, wherein:
at least one of the first memory device, the second memory device, or the third memory device comprises a flash memory device,
at least one of the first memory device, the second memory device, or the third memory device comprises a dynamic random-access memory device, and
at least one of the first memory device, the second memory device, or the third memory device comprises a resistance variable memory device.

### Claim 21 (depends on 17)

The system of claim 17, wherein the processor is to:
determine that the first memory device or the second memory device or the third memory device exhibits a higher bandwidth than another of the first memory device or the second memory device or the third memory device; and
perform the operation to reallocate computing resources amongst the first memory device, the second memory device, or the third memory device, or any combination thereof, such that:
greater than a threshold amount of memory that exhibits the higher bandwidth is available to perform the operation to resolve the unknown obj ect, or
greater than a threshold amount of memory that exhibits the faster memory access time is available to perform the operation to resolve the unknown object; and
perform, using the reallocated computing resources, the operation involving the unidentifiable pixels corresponding to the unknown object to resolve the unknown object using the first memory device, the second memory device, or the third memory device, or any combination thereof, that exhibits the higher bandwidth to perform the operation to resolve the unknown object, or the faster memory access time to perform the operation to resolve the unknown object, or both.

### Claim 22 (depends on 17)

The system of claim 17, wherein the processor is to:
determine that the mobile computing device has experienced a handoff from a first base station to a second base station; and
perform the operation to reallocate computing resources between the first memory device and the second memory device responsive to the determination that the mobile computing device has experienced the handoff.

### Claim 23 (depends on 17)

The system of claim 17, wherein the processor is to generate vibrational patterns corresponding to navigation in the presence of the unknown object or voice-assisted navigation updates corresponding to navigation in the presence of the unknown object, or both.

### Claim 24 (depends on 17)

The system of claim 17, wherein the processor is to perform the operation involving the unidentifiable pixels corresponding to the unknown object to resolve the unknown object as part of execution of instructions to assist a visually impaired user of the mobile computing device.
