# US 2016/0253050 A1 · System and method for audio and tactile based browsing

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2016/0253050 A1
- Document ID: US20160253050A1
- Status: Published application
- Kind: A1
- Application number: 15/054,064
- Filed: 2016-02-25
- Published: 2016-09-01
- Earliest claimed: 2015-02-26
- Assignees: Fingertips Lab, Inc.
- Applicants: Fingertips Lab, Inc.
- Inventors: Pradyumna Kumar Mishra; Byong-ho Park
- Web page: https://patentgrep.com/patent/US20160253050A1

## CPC

- G06F 3/0482: Interaction with lists of selectable items, e.g. menus
- G06F 3/0362: with detection of one-dimensional [1D] translations or rotations of an operating part of the device, e.g. scroll wheels, sliders, knobs, rollers or belts
- G06F 3/0485: Scrolling or panning
- G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback}
- G06F 16/9577: {Optimising the visualization of content, e.g. distillation of HTML documents}
- G06F 40/131: Fragmentation of text files, e.g. creating reusable text-blocks; Linking to fragments, e.g. using XInclude; Namespaces
- G06F 40/137: Hierarchical processing, e.g. outlines
- G06F 40/14: Tree-structured documents (parsing G06F40/205; validation G06F40/226)
- H04M 1/72412: using two-way short-range wireless interfaces
- G10L 13/033: Voice editing, e.g. manipulating the voice of the synthesiser
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- H04M: TELEPHONIC COMMUNICATION (circuits for controlling other apparatus via a telephone cable and not involving telephone switching apparatus G08)
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING

## Abstract

A system and method for a user interface that includes a controller apparatus that comprises at least two buttons and a rotary scrolling input element; a data connection between the controller apparatus and a navigable hierarchy of content; the rotary scrolling input element configured to communicate a change in selection state in the at least one navigable hierarchy of content; a first button of the at least two buttons configured to communicate a primary action on a currently selected item in the at least one navigable hierarchy of content; a second button of the at least two buttons configured to communicate a secondary action to the current state of the navigable hierarchy of content; and an audio engine that presents an audio interface output in response to communicated actions and navigation state of the hierarch of content.

## Claims

### Claim 1

A system for a user interface comprising:
a controller apparatus with a set of inputs that comprises at least two buttons and a rotary scrolling input element;
a data connection between the controller apparatus and at least one navigable hierarchy of content;
the rotary scrolling input element configured to communicate a change in selection state in the at least one navigable hierarchy of content;
a first button configured to communicate a primary action on a currently selected item in the at least one navigable hierarchy of content; and
a second button configured to communicate a secondary action to the current state of the navigable hierarchy of content.

### Claim 2 (depends on 1)

The system of claim 1, further comprising:
an audio engine that presents an audio interface output in response to communicated actions and navigation state of the hierarch of content;
wherein at least one of the two buttons is circumscribed by the other button.

### Claim 3 (depends on 2)

The system of claim 2, further comprising a third button integrated with the rotary scrolling input element, wherein the third button is configured to communicate an options action according to the current state of the navigable hierarchy of content.

### Claim 4 (depends on 2)

The system of claim 2, wherein the audio engine is operable on a secondary device and further comprises an audio content browser and a set of voice synthesizers, wherein the audio content browser is configured to translate media content to an audio description using one of the set of voice synthesizers.

### Claim 5 (depends on 1)

The system of claim 1, wherein the controller apparatus comprises a fixture interface compatible with a steering wheel.

### Claim 6 (depends on 1)

The system of claim 1, wherein the first button is additionally configured to communicate an option action upon detecting a pattern of button events.

### Claim 7 (depends on 1)

The system of claim 1, wherein the controller apparatus is configured for at least two modes of control over at least two types of navigable hierarchies of content; wherein the action commands for the at least two modes of control are transmitted simultaneously through the data connection.

### Claim 8 (depends on 7)

The system of claim 7, wherein the first mode of control is smart audio navigation for an application with audio navigation integration and the second mode of control is an accessibility mode for device accessibility tools.

### Claim 9 (depends on 1)

The system of claim 1, wherein the data connection between the controller apparatus and the at least one navigable hierarchy of content is switched to at least a second navigable hierarchy of content, wherein a first navigable hierarchy is for a first device, and the second navigable hierarchy of content is for a second device.

### Claim 10

A method for audio browsing comprising:
presenting a hierarchical content through at least an audio interface;
controlling navigation of the hierarchical content in response to a set of actions comprising:
detecting a scrolling action and adjusting current state of the hierarchical content to
detecting a primary action and initiating a primary action of a currently selected item in the hierarchical content; and

### Claim 11 (depends on 10)

The method of claim 10, further comprising detecting a reverting action and returning to a previous state of the hierarchical content; wherein detecting a scrolling action comprises receiving a scrolling event from a rotary scrolling element of a controller device; wherein detecting a primary action comprises receiving a button event from a first button of the controller device; wherein detecting a reverting action comprises receiving a button event from a second button of the controller device; wherein at least one of the first or second button circumscribes the corresponding button in an orientation independent arrangement on the controller device.

### Claim 12 (depends on 11)

The method of claim 11, wherein controlling navigation of the hierarchical content further comprises detecting an options action and contextually triggering action options for the current state of the hierarchical content.

### Claim 13 (depends on 12)

The method of claim 12, wherein the triggering action options comprises generating a set of context-sensitive action options through machine learning analysis of content from the currently selected item in the hierarchical content and presenting the set of context-sensitive action options.

### Claim 14 (depends on 12)

The method of claim 12, wherein detecting an options action comprises receiving a button event from a third button of the controller device; wherein the third button is an orientation independent arrangement with the first and second button.

### Claim 15 (depends on 12)

The method of claim 12, wherein detecting an options action comprises detecting a pattern of input from one of the first button or the second button.

### Claim 16 (depends on 11)

The method of claim 11, wherein presenting the hierarchical content comprises rendering the hierarchical content visually in a modular navigation mode.

### Claim 17 (depends on 11)

The method of claim 11, further comprising for at least a subset of the hierarchical content converting media content of a first format into hierarchically navigated content.

### Claim 18 (depends on 17)

The method of claim 17, wherein converting media content comprises applying artificial intelligence in customizing the converting of media content.

### Claim 19 (depends on 17)

The method of claim 17, wherein converting media content comprises generating summaries of linked content from within a document and making the content accessible through an action.

### Claim 20 (depends on 10)

The method of claim 10, wherein controlling navigation of the hierarchical content comprises receiving a spoken directive and updating the state of the hierarchical content according to the spoken directive.
