# US 2014/0278072 A1 · Voice and touch user interface

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2014/0278072 A1
- Document ID: US20140278072A1
- Status: Published application
- Kind: A1
- Application number: 14/209,815
- Filed: 2014-03-13
- Published: 2014-09-18
- Earliest claimed: 2013-03-15
- Assignees: Apple Inc.
- Applicants: Apple Inc.
- Inventors: Jorge S. FINO; Imran Chaudhri; Scott M. Herz; Justin E. Santamaria; Donald W. Pitschel
- Web page: https://patentgrep.com/patent/US20140278072A1

## CPC

- G01C 21/3697: {Output of additional, non-guidance related information, e.g. low fuel level (G01C21/3679 takes precedence)}
- G01C 21/36: Input/output arrangements for on-board computers
- G01C 21/362: {received from an external device or application, e.g. PDA, mobile phone or calendar application}
- G01C: MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY (measuring liquid level G01F; radio navigation, determining distance or velocity by use of propagation effects, e.g. Doppler effects, propagation time, of radio waves, analogous arrangements using other waves G01S)

## Abstract

Various examples are directed to an electronic device capable of touch input through a touch-sensitive surface and/or voice input through a microphone. In some examples, the electronic device may be used in an automobile. For example, some or all of the electronic device may be mounted in a dashboard for use while driving. The electronic device may provide informational content, entertainment content, navigation, and communication features in such a manner that user interaction may be minimized, thus providing a safe driving experience. This can be accomplished by performing tasks and presenting content automatically, without the need for user input, and by allowing user input through voice controls, touch screen controls, and/or physical controls mounted on the dashboard or steering wheel, among other possibilities.

## Claims

### Claim 1

A computer-implemented method, comprising:
at an electronic device including one or more processors and a memory:
determining a current location;
receiving a destination location;
determining a route from the current location to the destination location;
calculating a route duration based on the route;
selecting a plurality of audio clips based on a comparison of the combined duration of the audio clips and the route duration; and
creating an audio program based on the selected plurality of audio clips.

### Claim 2 (depends on 1)

The method of claim 1, wherein the current location is determined based on at least one of GPS, correlations from known access points, radio tower triangulation, and cell tower triangulation.

### Claim 3 (depends on 1)

The method of claim 1, further comprising:
updating the current location;
calculating a remaining route duration from the updated current location; and
editing the audio program based on a comparison of the remaining duration of the audio program and the remaining route duration.

### Claim 4 (depends on 3)

The method of claim 3, wherein updating the current location includes a determining a new location.

### Claim 5 (depends on 1)

The method of claim 1, wherein selecting the plurality of audio clips further comprises:
selecting text content;
generating an audio clip based on the text content; and
selecting the generated audio clip.

### Claim 6 (depends on 1)

The method of claim 1, further comprising:
monitoring route information, including one or both of traffic information and a current location;
updating an arrival time based on the route information;
comparing the updated arrival time to an appointment time associated with an appointment;
based on the comparison, determining that the arrival time is later than the appointment time; and
sending a message to one or more contacts associated with the appointment.

### Claim 7 (depends on 6)

The method of claim 6, wherein the route information is monitored periodically.

### Claim 8 (depends on 6)

The method claim 6, further comprising:
calculating a difference between the arrival time and the appointment time, wherein the text of the message includes the difference between the arrival time and the appointment time.

### Claim 9 (depends on 1)

The method of claim 1, further comprising:
generating a first playlist and a second playlist, each associated with a plurality of audio clips;
displaying a first user interface object associated with the first playlist and a second user interface object associated with the second playlist; and
in response to activation of a seek mode:
automatically playing an excerpt of a first audio clip of the first playlist;
displaying an indication of the first playlist while the first audio clip is playing;
after playing the excerpt of the first audio clip, automatically playing an excerpt of a second audio clip of the second playlist; and
displaying an indication of the second playlist while the second audio clip is playing.

### Claim 10 (depends on 1)

The method of claim 1, further comprising:
determining a first location associated with a contact of a message in a messaging application;
determining a second location associated with a search result in a web browsing application;
determining a third location associated with a route in a navigating application; and
displaying a list of recent locations comprising a user interface object for each of the first, second, and third locations.

### Claim 11 (depends on 1)

The method of claim 1, further comprising:
determining a list of contacts associated with one or more messages received;
determining a location for each of the contacts in the list of contacts; and
displaying one or more of the locations in a list of recent locations.

### Claim 12 (depends on 1)

The method of claim 1, further comprising:
determining that an automobile is in motion; and
based on the determination that the automobile is in motion, operating in a limited input mode, wherein operating in the limited input mode comprises:
in response to an operation requesting text entry, displaying an indication that voice input is requested and receiving voice input from a user; and
processing the voice input to generate text for the requested text entry.

### Claim 13

An electronic device, comprising:
one or more processors;
memory; and
one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for:
determining a current location;
receiving a destination location;
determining a route from the current location to the destination location;
calculating a route duration based on the route;
selecting a plurality of audio clips based on a comparison of the combined duration of the audio clips and the route duration; and
creating an audio program based on the selected plurality of audio clips.

### Claim 14 (depends on 13)

The electronic device of claim 13, wherein the current location is determined based on at least one of GPS, correlations from known access points, radio tower triangulation, and cell tower triangulation.

### Claim 15 (depends on 13)

The electronic device of claim 13, the one or more programs further including instructions for:
updating the current location;
calculating a remaining route duration from the updated current location; and
editing the audio program based on a comparison of the remaining duration of the audio program and the remaining route duration.

### Claim 16 (depends on 15)

The electronic device of claim 15, wherein updating the current location includes a determining a new location.

### Claim 17 (depends on 13)

The electronic device of claim 13, wherein selecting the plurality of audio clips further comprises:
selecting text content;
generating an audio clip based on the text content; and
selecting the generated audio clip.

### Claim 18 (depends on 13)

The electronic device of claim 13, the one or more programs further including instructions for:
monitoring route information, including one or both of traffic information and a current location;
updating an arrival time based on the route information;
comparing the updated arrival time to an appointment time associated with an appointment;
based on the comparison, determining that the arrival time is later than the appointment time; and
sending a message to one or more contacts associated with the appointment.

### Claim 19 (depends on 18)

The electronic device of claim 18, wherein the route information is monitored periodically.

### Claim 20 (depends on 18)

The electronic device claim 18, the one or more programs further including instructions for:
calculating a difference between the arrival time and the appointment time, wherein the text of the message includes the difference between the arrival time and the appointment time.

### Claim 21 (depends on 13)

The electronic device of claim 13, the one or more programs further including instructions for:
generating a first playlist and a second playlist, each associated with a plurality of audio clips;
displaying a first user interface object associated with the first playlist and a second user interface object associated with the second playlist; and
in response to activation of a seek mode:
automatically playing an excerpt of a first audio clip of the first playlist;
displaying an indication of the first playlist while the first audio clip is playing;
after playing the excerpt of the first audio clip, automatically playing an excerpt of a second audio clip of the second playlist; and
displaying an indication of the second playlist while the second audio clip is playing.

### Claim 22 (depends on 13)

The electronic device of claim 13, the one or more programs further including instructions for:
determining a first location associated with a contact of a message in a messaging application;
determining a second location associated with a search result in a web browsing application;
determining a third location associated with a route in a navigating application; and
displaying a list of recent locations comprising a user interface object for each of the first, second, and third locations.

### Claim 23 (depends on 13)

The electronic device of claim 13, the one or more programs further including instructions for:
determining a list of contacts associated with one or more messages received;
determining a location for each of the contacts in the list of contacts; and
displaying one or more of the locations in a list of recent locations.

### Claim 24 (depends on 13)

The electronic device of claim 13, the one or more programs further including instructions for:
determining that an automobile is in motion; and
based on the determination that the automobile is in motion, operating in a limited input mode, wherein operating in the limited input mode comprises:
in response to an operation requesting text entry, displaying an indication that voice input is requested and receiving voice input from a user; and
processing the voice input to generate text for the requested text entry.

### Claim 25

A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by an electronic device, cause the device to perform a method comprising:
determining a current location;
receiving a destination location;
determining a route from the current location to the destination location;
calculating a route duration based on the route;
selecting a plurality of audio clips based on a comparison of the combined duration of the audio clips and the route duration; and
creating an audio program based on the selected plurality of audio clips.

### Claim 26 (depends on 25)

The non-transitory computer readable storage medium of claim 25, wherein the current location is determined based on at least one of GPS, correlations from known access points, radio tower triangulation, and cell tower triangulation.

### Claim 27 (depends on 25)

The non-transitory computer readable storage medium of claim 25, the method further comprising:
updating the current location;
calculating a remaining route duration from the updated current location; and
editing the audio program based on a comparison of the remaining duration of the audio program and the remaining route duration.

### Claim 28 (depends on 27)

The non-transitory computer readable storage medium of claim 27, wherein updating the current location includes a determining a new location.

### Claim 29 (depends on 25)

The non-transitory computer readable storage medium of claim 25, wherein selecting the plurality of audio clips further comprises:
selecting text content;
generating an audio clip based on the text content; and
selecting the generated audio clip.

### Claim 30 (depends on 25)

The non-transitory computer readable storage medium of claim 25, the method further comprising:
monitoring route information, including one or both of traffic information and a current location;
updating an arrival time based on the route information;
comparing the updated arrival time to an appointment time associated with an appointment;
based on the comparison, determining that the arrival time is later than the appointment time; and
sending a message to one or more contacts associated with the appointment.

### Claim 31 (depends on 30)

The non-transitory computer readable storage medium of claim 30, wherein the route information is monitored periodically.

### Claim 32 (depends on 30)

The non-transitory computer readable storage medium claim 30, the method further comprising:
calculating a difference between the arrival time and the appointment time, wherein the text of the message includes the difference between the arrival time and the appointment time.

### Claim 33 (depends on 25)

The non-transitory computer readable storage medium of claim 25, the method further comprising:
generating a first playlist and a second playlist, each associated with a plurality of audio clips;
displaying a first user interface object associated with the first playlist and a second user interface object associated with the second playlist; and
in response to activation of a seek mode:
automatically playing an excerpt of a first audio clip of the first playlist;
displaying an indication of the first playlist while the first audio clip is playing;
after playing the excerpt of the first audio clip, automatically playing an excerpt of a second audio clip of the second playlist; and
displaying an indication of the second playlist while the second audio clip is playing.

### Claim 34 (depends on 25)

The non-transitory computer readable storage medium of claim 25, the method further comprising:
determining a first location associated with a contact of a message in a messaging application;
determining a second location associated with a search result in a web browsing application;
determining a third location associated with a route in a navigating application; and
displaying a list of recent locations comprising a user interface object for each of the first, second, and third locations.

### Claim 35 (depends on 25)

The non-transitory computer readable storage medium of claim 25, the method further comprising:
determining a list of contacts associated with one or more messages received;
determining a location for each of the contacts in the list of contacts; and
displaying one or more of the locations in a list of recent locations.

### Claim 36 (depends on 25)

The non-transitory computer readable storage medium of claim 25, the method further comprising:
determining that an automobile is in motion; and
based on the determination that the automobile is in motion, operating in a limited input mode, wherein operating in the limited input mode comprises:
in response to an operation requesting text entry, displaying an indication that voice input is requested and receiving voice input from a user; and
processing the voice input to generate text for the requested text entry.
