# US 2013/0159861 A1 · Adaptive Audio Feedback System and Method

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2013/0159861 A1
- Document ID: US20130159861A1
- Status: Published application
- Kind: A1
- Application number: 13/769,217
- Filed: 2013-02-15
- Published: 2013-06-20
- Earliest claimed: 2010-01-13
- Assignees: Apple Inc.
- Inventors: Benjamin A. Rottler; Aram M. Lindahl; Allen Paul Haughay, JR.; Shawn A. Ellis; Policarpo Bonilla Wood, JR.
- Web page: https://patentgrep.com/patent/US20130159861A1

## CPC

- G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback}
- G06F 3/0482: Interaction with lists of selectable items, e.g. menus
- G10L 13/00: Speech synthesis; Text to speech systems
- G10L 15/00: Speech recognition (G10L17/00 takes precedence)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING

## Abstract

Various techniques for adaptively varying audio feedback data on an electronic device are provided. In one embodiment, an audio user interface implementing certain aspects of the present disclosure may devolve or evolve the verbosity of audio feedback in response to user interface events based at least partially upon the verbosity level of audio feedback provided during previous occurrences of the user interface event. In another embodiment, an audio user interface may be configured to vary the verbosity of audio feedback associated with a navigable list of items based at least partially upon the speed at which a user navigates the list. In a further embodiment, an audio user interface may be configured to vary audio feedback verbosity based upon the contextual importance of a user interface event. Electronic devices implementing the present techniques provide an improved user experience with regard to audio user interfaces.

## Claims

### Claim 1

A method, comprising:
at an electronic device having one or more processors and memory:
detecting a respective occurrence of a user interface event requesting audio feedback on the electronic device at a first time;
in response to detecting the respective occurrence of the user interface event at the first time, identifying a plurality of audio items and a first visual notification associated with the user interface event, wherein each of the plurality of audio items has a different level of verbosity, and wherein the plurality of audio items include at least a first audio item having a first verbosity level corresponding to a verbosity level of the first visual notification, and a second audio item having a second verbosity level lower than the first verbosity level;
selecting the second audio item in accordance with at least a determination that the user interface event previously occurred within the particular time interval prior to the first time and that the first audio item was provided during said previous occurrence; and
concurrently providing the second audio item with the first visual notification on the electronic device, wherein the first audio item was provided with the first visual notification during said previous occurrence of the user interface event.

### Claim 2 (depends on 1)

The method of claim 1, further comprising:
in accordance with at least a determination that the user interface event did not previously occur within the particular time interval prior to the first time, selecting an audio item having the highest level of verbosity from the plurality of audio items for playback.

### Claim 3 (depends on 1)

The method of claim 1, further comprising:
detecting a subsequent occurrence of the user interface event on the electronic device at a second time; and
selecting a respective one of the plurality of audio items that corresponds to a respective desired verbosity level determined based upon the duration between the first time and the second time.

### Claim 4 (depends on 3)

The method of claim 3, wherein selecting said respective one audio item comprises:
in accordance with at least a determination that the duration between the first and second times is less than or equal to the particular time interval, selecting an audio item from the plurality of audio items that is at least one step less verbose relative to the second audio item; and
in accordance with at least a determination that the duration between the first and second times is greater than the particular time interval, selecting an audio item from the plurality of audio items that is at least one step more verbose relative to the second audio item.

### Claim 5 (depends on 3)

The method of claim 3, further comprising:
providing said respective one audio item without concurrently providing the first visual notification on the electronic device.

### Claim 6 (depends on 3)

The method of claim 3, wherein selecting the respective one audio item comprises:
determining whether a playback termination event was detected during the respective occurrence of the user interface event at the second time; and
in accordance with at least a determination that a playback termination event was detected during the respective occurrence at the second time, selecting an audio item from the plurality of audio items having a lower level of verbosity regardless of the verbosity level of the previously selected second audio item.

### Claim 7 (depends on 3)

The method of claim 3, comprising:
determining whether a playback termination event was detected during the respective occurrence of the user interface event at the second time; and
in accordance with at least a determination that a playback termination event was not detected during the respective occurrence of the user interface event at the second time, providing the first visual notification concurrently with the playback of the selected respective one audio item; and
in accordance with at least a determination that a playback termination event was detected during the respective occurrence of the user interface event at the second time, providing a second visual notification concurrently with the playback of the selected respective one audio item, wherein the second visual notification is less verbose relative to the first visual notification.

### Claim 8 (depends on 7)

The method of claim 7, wherein displaying the second visual notification further comprises:
displaying the second visual notification at a second location in the graphical user interface that is less prominent than a first location at which the first visual notification was previously displayed.

### Claim 9

An electronic device, comprising:
one or more processors; and
memory having instructions stored thereon, the instructions, when executed by the one or more processors, cause the processors to perform operations comprising:
detecting a respective occurrence of a user interface event requesting audio feedback on the electronic device at a first time;
in response to detecting the respective occurrence of the user interface event at the first time, identifying a plurality of audio items and a first visual notification associated with the user interface event, wherein each of the plurality of audio items has a different level of verbosity, and wherein the plurality of audio items include at least a first audio item having a first verbosity level corresponding to a verbosity level of the first visual notification, and a second audio item having a second verbosity level lower than the first verbosity level;
selecting the second audio item in accordance with at least a determination that the user interface event previously occurred within the particular time interval prior to the first time and that the first audio item was provided during said previous occurrence; and
concurrently providing the second audio item with the first visual notification on the electronic device, wherein the first audio item was provided with the first visual notification during said previous occurrence of the user interface event.

### Claim 10 (depends on 9)

The device of claim 9, wherein the operations further comprise:
in accordance with at least a determination that the user interface event did not previously occur within the particular time interval prior to the first time, selecting an audio item having the highest level of verbosity from the plurality of audio items for playback.

### Claim 11 (depends on 9)

The device of claim 9, wherein the operations further comprise:
detecting a subsequent occurrence of the user interface event on the electronic device at a second time; and
selecting a respective one of the plurality of audio items that corresponds to a respective desired verbosity level determined based upon the duration between the first time and the second time.

### Claim 12 (depends on 11)

The device of claim 11, wherein selecting said respective one audio item comprises:
in accordance with at least a determination that the duration between the first and second times is less than or equal to the particular time interval, selecting an audio item from the plurality of audio items that is at least one step less verbose relative to the second audio item; and
in accordance with at least a determination that the duration between the first and second times is greater than the particular time interval, selecting an audio item from the plurality of audio items that is at least one step more verbose relative to the second audio item.

### Claim 13 (depends on 11)

The device of claim 11, wherein the operations further comprise:
providing said respective one audio item without concurrently providing the first visual notification on the electronic device.

### Claim 14 (depends on 11)

The device of claim 11, wherein selecting the respective one audio item comprises:
determining whether a playback termination event was detected during the respective occurrence of the user interface event at the second time; and
in accordance with at least a determination that a playback termination event was detected during the respective occurrence at the second time, selecting an audio item from the plurality of audio items having a lower level of verbosity regardless of the verbosity level of the previously selected second audio item.

### Claim 15 (depends on 11)

The device of claim 11, wherein the operations further comprise:
determining whether a playback termination event was detected during the respective occurrence of the user interface event at the second time; and
in accordance with at least a determination that a playback termination event was not detected during the respective occurrence of the user interface event at the second time, providing the first visual notification concurrently with the playback of the selected respective one audio item; and
in accordance with at least a determination that a playback termination event was detected during the respective occurrence of the user interface event at the second time, providing a second visual notification concurrently with the playback of the selected respective one audio item, wherein the second visual notification is less verbose relative to the first visual notification.

### Claim 16 (depends on 15)

The device of claim 15, wherein displaying the second visual notification further comprises:
displaying the second visual notification at a second location in the graphical user interface that is less prominent than a first location at which the first visual notification was previously displayed.

### Claim 17

A non-transitory computer-readable medium having instructions stored thereon, the instructions, when executed by the one or more processors, cause the processors to perform operations comprising:
detecting a respective occurrence of a user interface event requesting audio feedback on the electronic device at a first time;
in response to detecting the respective occurrence of the user interface event at the first time, identifying a plurality of audio items and a first visual notification associated with the user interface event, wherein each of the plurality of audio items has a different level of verbosity, and wherein the plurality of audio items include at least a first audio item having a first verbosity level corresponding to a verbosity level of the first visual notification, and a second audio item having a second verbosity level lower than the first verbosity level;
selecting the second audio item in accordance with at least a determination that the user interface event previously occurred within the particular time interval prior to the first time and that the first audio item was provided during said previous occurrence; and
concurrently providing the second audio item with the first visual notification on the electronic device, wherein the first audio item was provided with the first visual notification during said previous occurrence of the user interface event.

### Claim 18 (depends on 17)

The computer-readable medium of claim 17, wherein the operations further comprise:
in accordance with at least a determination that the user interface event did not previously occur within the particular time interval prior to the first time, selecting an audio item having the highest level of verbosity from the plurality of audio items for playback.

### Claim 19 (depends on 17)

The computer-readable medium of claim 17, wherein the operations further comprise:
detecting a subsequent occurrence of the user interface event on the electronic device at a second time; and
selecting a respective one of the plurality of audio items that corresponds to a respective desired verbosity level determined based upon the duration between the first time and the second time.

### Claim 20 (depends on 17)

The computer-readable medium of claim 17, wherein selecting said respective one audio item comprises:
in accordance with at least a determination that the duration between the first and second times is less than or equal to the particular time interval, selecting an audio item from the plurality of audio items that is at least one step less verbose relative to the second audio item; and
in accordance with at least a determination that the duration between the first and second times is greater than the particular time interval, selecting an audio item from the plurality of audio items that is at least one step more verbose relative to the second audio item.

### Claim 21 (depends on 20)

The computer-readable medium of claim 20, wherein the operations further comprise:
providing said respective one audio item without concurrently providing the first visual notification on the electronic device.

### Claim 22 (depends on 20)

The computer-readable medium of claim 20, wherein selecting the respective one audio item comprises:
determining whether a playback termination event was detected during the respective occurrence of the user interface event at the second time; and
in accordance with at least a determination that a playback termination event was detected during the respective occurrence at the second time, selecting an audio item from the plurality of audio items having a lower level of verbosity regardless of the verbosity level of the previously selected second audio item.

### Claim 23 (depends on 20)

The computer-readable medium of claim 20, wherein the operations further comprise:
determining whether a playback termination event was detected during the respective occurrence of the user interface event at the second time; and
in accordance with at least a determination that a playback termination event was not detected during the respective occurrence of the user interface event at the second time, providing the first visual notification concurrently with the playback of the selected respective one audio item; and
in accordance with at least a determination that a playback termination event was detected during the respective occurrence of the user interface event at the second time, providing a second visual notification concurrently with the playback of the selected respective one audio item, wherein the second visual notification is less verbose relative to the first visual notification.

### Claim 24 (depends on 23)

The computer-readable medium of claim 23, wherein displaying the second visual notification further comprises:
displaying the second visual notification at a second location in the graphical user interface that is less prominent than a first location at which the first visual notification was previously displayed.
