# US 2024/0004493 A1 · Assistive device with a refreshable haptic feedback interface to provide non-visual assistance to a user

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0004493 A1
- Document ID: US20240004493A1
- Status: Published application
- Kind: A1
- Application number: 18/469,933
- Filed: 2023-09-19
- Published: 2024-01-04
- Earliest claimed: 2017-09-20
- Inventors: Niki Mani; Alex Hamid Mani
- Web page: https://patentgrep.com/patent/US20240004493A1

## CPC

- G06F 3/0416: {Control or interface arrangements specially adapted for digitisers}
- G06F 3/016: {Input arrangements with force or tactile feedback as computer generated output to the user}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

An assistive device and method to provide non-visual assistance to a user, includes a haptic feedback interface that includes a plurality of haptic elements. The assistive device generates a touch-discernible output layout on the haptic feedback interface using the plurality of haptic elements. The touch-discernible output layout corresponds to a reproduction of a 3D real-world area within a proximity range of the assistive device and includes a set of different haptic indicators to discern movement of a set of moving objects within the proximity range. The assistive device receives a user input via the haptic feedback interface and tracking a movement of a target moving object in the 3D real-world area based on the received user input.

## Claims

### Claim 1

An assistive device, comprising:
a haptic feedback interface that comprises a plurality of haptic elements; and
a haptic feedback controller configured to:
generate a touch-discernible output layout on the haptic feedback interface using the plurality of haptic elements, wherein the touch-discernible output layout corresponds to a reproduction of a three-dimensional (3D) real-world area within a proximity range of the assistive device;
generate a set of different haptic indicators that are spatially arranged on the haptic feedback interface to discern a set of moving objects of the 3D real-world area within the proximity range, wherein the touch-discernible output layout includes the set of different haptic indicators;
receive a user input via the haptic feedback interface; and
track a movement of a target moving object in the 3D real-world area based on the received user input.

### Claim 2 (depends on 1)

The assistive device according to claim 1, wherein the haptic feedback controller is further configured to:
determine if the target moving object has moved from a first proximity range to a second proximity range; and
calibrate at least one sensor to receive sensor data in accordance with the second proximity range.

### Claim 3 (depends on 1)

The assistive device according to claim 1, wherein the user input comprises an amount of pressure applied on the set of different haptic indicators by a user of the assistive device, and wherein the haptic feedback controller is further configured to:
execute a first action based on a first amount of applied pressure; and
execute a second action based on a second amount of applied pressure different from the first amount of applied pressure.

### Claim 4 (depends on 3)

The assistive device according to claim 3, wherein the first action is executed based on the first amount of applied pressure greater than a first threshold pressure value, and wherein the second action is executed based on the second amount of applied pressure greater than a second threshold pressure value.

### Claim 5 (depends on 3)

The assistive device according to claim 3, wherein the at least one of the first action or the second action corresponds to a prompt to require additional information about the target moving object.

### Claim 6 (depends on 5)

The assistive device according to claim 5, wherein the additional information comprises at least one of a current location of the target moving object or a distance between the user and the target moving object.

### Claim 7 (depends on 1)

The assistive device according to claim 1, wherein, based on the tracked movement of the target moving object, the haptic feedback controller is further configured to output at least one of an audio feedback by one or more audio output devices provided in the assistive device or one or more haptic mobility signals with the touch-discernible output layout to provide navigational assistance from a current position of the user of the assistive device towards the target moving object.

### Claim 8 (depends on 1)

The assistive device according to claim 1, wherein the haptic feedback controller is further configured to differently control a rate-of-change of movement of each of the set of different haptic indicators on the haptic feedback interface based on a distance of each of the set of moving objects present in the 3D real-world from the user of the assistive device.

### Claim 9 (depends on 8)

The assistive device according to claim 8, further comprising a circuitry configured to determine a spatial scaling factor for each of the set of moving objects present in the 3D real-world based on the distance of each of the set of moving objects from the user of the assistive device, wherein the rate-of-change of movement of each of the set of different haptic indicators is controlled in accordance with the spatial scaling factor determined for a corresponding moving object of the set of moving objects.

### Claim 10 (depends on 1)

The assistive device according to claim 1, wherein the haptic feedback controller is further configured to differently control a size of each of the set of different haptic indicators on the haptic feedback interface based on a distance of each of the set of moving objects present in the 3D real-world from the user.

### Claim 11 (depends on 1)

The assistive device according to claim 1, wherein the set of different haptic indicators are generated by a touch-discernible modality that includes at least one of a differential temperature-based modality, a differential electric pulse-based modality, a differential raised shape pattern-based modality, or a combination of different touch-discernible modalities.

### Claim 12

An assistive method, comprising:
in an assistive device that comprises a haptic feedback controller and a haptic feedback interface that includes a plurality of haptic elements:
generating a touch-discernible output layout on the haptic feedback interface using the plurality of haptic elements, wherein the touch-discernible output layout corresponds to a reproduction of a three-dimensional (3D) real-world area within a proximity range of the assistive device;
generating a set of different haptic indicators that are spatially arranged on the haptic feedback interface to discern a set of moving objects of the 3D real-world area within the proximity range, wherein the touch-discernible output layout includes the set of different haptic indicators;
receiving a user input via the haptic feedback interface; and
tracking a movement of a target moving object in the 3D real-world area based on the received user input.

### Claim 13 (depends on 12)

The assistive method according to claim 12, further comprising:
determining if the target moving object has moved from a first proximity range to a second proximity range; and
calibrating at least one sensor to receive sensor data in accordance with the second proximity range.

### Claim 14 (depends on 12)

The assistive method according to claim 12, wherein the user input comprises an amount of pressure applied on the set of different haptic indicators by a user of the assistive device, and wherein the method further comprises:
executing a first action based on a first amount of applied pressure; and
executing a second action based on a second amount of applied pressure different from the first amount of applied pressure.

### Claim 15 (depends on 14)

The assistive method according to claim 14, wherein the first action is executed based on the first amount of applied pressure greater than a first threshold pressure value, and wherein the second action is executed based on the second amount of applied pressure greater than a second threshold pressure value.

### Claim 16 (depends on 14)

The assistive method according to claim 14, wherein the at least one of the first action or the second action corresponds to a prompt to require additional information about the target moving object.

### Claim 17 (depends on 16)

The assistive method according to claim 16, wherein the additional information comprises at least one of a current location of the target moving object or a distance between the user and the target moving object.

### Claim 18 (depends on 12)

The assistive method according to claim 12, wherein, based on the tracked movement of the target moving object, outputting at least one of: an audio feedback by one or more audio output devices provided in the assistive device or one or more haptic mobility signals with the touch-discernible output layout for providing navigational assistance from a current position of the user of the assistive device towards the target moving object.

### Claim 19 (depends on 12)

The assistive method according to claim 12, further comprising differently controlling a rate-of-change of movement of each of the set of different haptic indicators on the haptic feedback interface based on a distance of each of the set of moving objects present in the 3D real-world from the user of the assistive device.

### Claim 20 (depends on 19)

The assistive method according to claim 19, further comprising determining a spatial scaling factor for each of the set of moving objects present in the 3D real-world based on the distance of each of the set of moving objects from the user of the assistive device, wherein the rate-of-change of movement of each of the set of different haptic indicators is controlled in accordance with the spatial scaling factor determined for a corresponding moving object of the set of moving objects.
