# US 2019/0171289 A1 · Tactile feedback array control

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0171289 A1
- Document ID: US20190171289A1
- Status: Published application
- Kind: A1
- Application number: 15/829,037
- Filed: 2017-12-01
- Published: 2019-06-06
- Earliest claimed: 2017-12-01
- Assignees: Yahoo Holdings, Inc.
- Applicants: Yahoo Holdings, Inc.
- Inventors: Sukriti Chadha
- Web page: https://patentgrep.com/patent/US20190171289A1

## CPC

- G06F 3/016: {Input arrangements with force or tactile feedback as computer generated output to the user}
- A63F 13/285: Generating tactile feedback signals via the game input device, e.g. force feedback
- A63F 13/533: for prompting the player, e.g. by displaying a game menu
- G06F 1/1626: {with a single-body enclosure integrating a flat display, e.g. Personal Digital Assistants [PDAs]}
- G06F 1/1684: {Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675}
- G06F 1/169: {the I/O peripheral being an integrated pointing device, e.g. trackball in the palm rest area, mini-joystick integrated between keyboard keys, touch pads or touch stripes (G06F1/1643 takes precedence; constructional details of pointing devices G06F3/033)}
- G06F 3/03547: {Touch pads, in which fingers can move on a surface}
- G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback}
- G09B 21/00: Teaching, or communicating with, the blind, deaf or mute (audible presentation of material to be studied G09B5/04; devices or methods for replacing direct visual or auditory perception by another kind of perception A61F9/08, A61F11/04; audible indication of meter readings or of colour G01D7/12; watches for blind persons G04B25/02; speech analysis, speech recognition G10L; sound-recording or reproducing, per se G11B)
- G09B 21/003: {using tactile presentation of the information, e.g. Braille displays}
- A63F 13/67: adaptively or by learning from player actions, e.g. skill level adjustment or by storing successful combat sequences for re-use
- G06F 3/04883: for inputting data by handwriting, e.g. gesture or text
- G06F 2203/014: Force feedback applied to GUI
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- A63F: CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- G09B: EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS (devices for psychotechnics or for testing reaction times A61B5/16; games, sports, amusements A63; projectors, projector screens G03B)

## Abstract

One or more computing devices, systems, and/or methods for controlling a tactile feedback array are provided. For example, object information of objects displayed within a user interface rendered on a display screen of a computing device is extracted. The object information is evaluated to identify a target object. A location of the target object within the user interface relative to the tactile feedback array is determined. One or more tactile feedback devices of the tactile feedback array are triggered to activate based upon the location of the target object.

## Claims

### Claim 1

A method of controlling a tactile feedback array, comprising:
executing, on a processor of a computing device, instructions that cause the computing device to perform operations, the operations comprising:
extracting object information of objects renderable within a user interface on a display screen of the computing device;
evaluating the object information to identify a target object;
determining a location of the target object within the user interface relative to a tactile feedback array associated with the computing device; and
trigging one or more tactile feedback devices of the tactile feedback array to activate based upon the location of the target object.

### Claim 2 (depends on 1)

The method of claim 1, comprising:
tracking movement of the target object within the user interface; and
trigging tactile feedback devices to activate based upon the movement of the target object.

### Claim 3 (depends on 2)

The method of claim 2, comprising:
evaluating the object information to identify a second target object;
tracking movement of the target object and the second target object within the user interface; and
trigging tactile feedback devices to activate based upon the movement of the target object and the movement of the second target object.

### Claim 4 (depends on 3)

The method of claim 3, comprising:
determining a first activation intensity for the target object and a second activation intensity for the second target object; and
triggering tactile feedback devices for the target object according to the first activation intensity and tactile feedback devices for the second target object according to the second activation intensity.

### Claim 5 (depends on 3)

The method of claim 3, comprising:
determining a first activation duration for the target object and a second activation duration for the second target object; and
triggering tactile feedback devices for the target object according to the first activation duration and tactile feedback devices for the second target object according to the second activation duration.

### Claim 6 (depends on 1)

The method of claim 1, comprising:
evaluating the object information to identify a set of target objects representing data points; and
triggering tactile feedback devices to activate according to a sequential pattern according to locations of the set of target objects.

### Claim 7 (depends on 1)

The method of claim 1, comprising:
determining an activation intensity for the target object; and
triggering the one or more tactile feedback devices according to the activation intensity.

### Claim 8 (depends on 1)

The method of claim 1, comprising:
determining a set of activation intensities for the target object; and
triggering the one or more tactile feedback devices according to the set of activation intensities, wherein a first tactile feedback device is triggered to activate at a first activation intensity and a second tactile feedback device is triggered to activate at a second activation intensity different than the first activation intensity.

### Claim 9 (depends on 1)

The method of claim 1, comprising:
determining an activation duration for the target object; and
triggering the one or more tactile feedback devices according to the activation duration.

### Claim 10 (depends on 1)

The method of claim 1, comprising:
determining a set of activation durations for the target object; and
triggering the one or more tactile feedback devices according to the set of activation durations, wherein a first tactile feedback device is triggered to activate at a first activation duration and a second tactile feedback device is triggered to activate at a second activation duration different than the first activation duration.

### Claim 11

A computing device comprising:
a processor; and
memory comprising processor-executable instructions that when executed by the processor cause performance of operations, the operations comprising:
maintaining a mapping that maps locations of tactile feedback devices of a tactile feedback array to display locations of a display of the computing device;
extracting object information of objects renderable within a user interface on the display of the computing device;
evaluating the object information to identify a target object;
identifying a display location corresponding to a location of the target object within the user interface;
evaluating the mapping to determine that one or more tactile feedback devices correspond to the display location; and
triggering the one or more tactile feedback devices to activate.

### Claim 12 (depends on 11)

The computing device of claim 11, wherein the operations comprise:
tracking movement of the target object within the user interface; and
trigging tactile feedback devices to activate based upon the movement of the target object.

### Claim 13 (depends on 12)

The computing device of claim 12, where in the operations comprise:
determining a timing for triggering the tactile feedback devices; and
trigging the tactile feedback devices to activate based upon the timing.

### Claim 14 (depends on 12)

The computing device of claim 12, where in the operations comprise:
determining an activation duration for triggering tactile feedback devices; and
trigging the one or more tactile feedback devices to activate based upon the activation duration.

### Claim 15 (depends on 11)

The computing device of claim 11, wherein the target object is a data point within a graph.

### Claim 16 (depends on 11)

The computing device of claim 11, comprising:
receiving user input for the target object;
trigging tactile feedback devices, corresponding to a current location of the target object, to activate based upon the user input; and
triggering playback of an audio description of the target object based upon the user input.

### Claim 17

A non-transitory machine readable medium having stored thereon processor-executable instructions that when executed cause performance of operations, the operations comprising:
extracting object information of objects renderable within a user interface on a display screen of a computing device;
evaluating the object information to identify a target object;
tracking movement of the target object within the user interface relative to a tactile feedback array associated with the computing device; and
trigging one or more tactile feedback devices to activate based upon the movement of the target object.

### Claim 18 (depends on 17)

The non-transitory machine readable medium of claim 17, wherein the target object is a moving object within a video being played through the user interface.

### Claim 19 (depends on 17)

The non-transitory machine readable medium of claim 17, wherein the operations comprise:
evaluating the object information using machine learning functionality to selectively determine which tactile feedback devices to trigger in response to movement of the target object.

### Claim 20 (depends on 17)

The non-transitory machine readable medium of claim 17, wherein the operations comprise:
evaluating input data received through the computing device to determine body part information of body parts used to interact with the computing device; and
setting an activation intensity setting, an activation duration setting, and an activation timing setting for triggering the tactile feedback devices based upon the body part information.
