US 11,907,436 B2Granted

Raise to speak

AssigneeApple Inc.

InventorsStephen O. Lemay, Michael R. Bastian, Roman Holenstein, Minwoo Jeong, Charles Maalouf, Brandon J. Newendorp, Heriberto Nieto, Timothy Paek, Joanna Peterson, Shawn Scully, Srikrishna Sridhar, Brandt M. Westing, Shiwen Zhao

Life of this patent

Estimating the term…

patentgrep

Loading patent…

Abstract

Systems and processes for operating an intelligent automated assistant are provided. An example process includes detecting input representing motion of an electronic device and sampling an audio input with a microphone of the electronic device. The example process further includes determining, based on the audio input and the input representing motion of the electronic device, whether to initiate a virtual assistant session. In accordance with a determination to initiate the virtual assistant session, the example process includes initiating the virtual assistant session. In accordance with a determination not to initiate the virtual assistant session, the example process includes forgoing initiating the virtual assistant session.

Claims70

Dependent claims

A non-transitory computer-readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by one or more processors of an electronic device with a microphone and a display, cause the electronic device to:

detect input representing motion of the electronic device;
while detecting at least a portion of the input representing motion of the electronic device, sample, with the microphone, an audio input;
determine, based on the audio input and the input representing motion of the electronic device, whether to initiate a virtual assistant session, wherein determining whether to initiate the virtual assistant session includes:
determining, at a first time, whether to initiate the virtual assistant session based on the audio input;
determining, at a second time, whether to initiate the virtual assistant session based on the input representing motion of the electronic device;
determining whether the first time and the second time are within a predetermined duration;
and
determining to initiate the virtual assistant session in accordance with a determination that the first time and the second time are within the predetermined duration;
in accordance with a determination to initiate the virtual assistant session, initiate the virtual assistant session;
and
in accordance with a determination not to initiate the virtual assistant session, forgo initiating the virtual assistant session.

8 more elements

An electronic device, comprising:

a microphone;
a display;
one or more processors;
a memory;
and
one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for:
detecting input representing motion of the electronic device;
while detecting at least a portion of the input representing motion of the electronic device, sampling, with the microphone, an audio input;
determining, based on the audio input and the input representing motion of the electronic device, whether to initiate a virtual assistant session, wherein determining whether to initiate the virtual assistant session includes:
determining, at a first time, whether to initiate the virtual assistant session based on the audio input;
determining, at a second time, whether to initiate the virtual assistant session based on the input representing motion of the electronic device;
determining whether the first time and the second time are within a predetermined duration;
and
determining to initiate the virtual assistant session in accordance with a determination that the first time and the second time are within the predetermined duration;
in accordance with a determination to initiate the virtual assistant session, initiating the virtual assistant session;
and
in accordance with a determination not to initiate the virtual assistant session, forgoing initiating the virtual assistant session.

14 more elements

Dependencies are inferred from the claim text.

Facts

Application: 17/946,959Filed 16 Sep 2022 · continuation
Priority: 7 May 2018
Published: US 2023/0040703 A19 Feb 2023
Granted: 20 Feb 2024
Term ends: Not estimatedThe source records don’t support an estimate.

Classification20 codes

G06F 3/017
Input arrangements or combined input and output arrangements for interaction between user and computer: gesture based interaction, e.g. based on a…
G06F 1/163
For portable computers: wearable computers, e.g. on a belt
G06F 1/1684
Constructional details or arrangements of portable computers not specific to the type of enclosures covered by groups G06F1/1615 - G06F1/1626:…
G06F 1/1694
Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675: the I/O peripheral…

Family

Application62/668,154Us provisional application · filed 7 May 2018
Application62/679,798Us provisional application · filed 2 Jun 2018
Application16/032,487Parent of this continuation · filed 11 Jul 2018
Application17/033,349Parent of this continuation · filed 25 Sep 2020
US 10,928,918 B2Parent of this continuation · filed 23 Feb 2021
Application17/489,307Parent of this continuation · filed 29 Sep 2021
US 11,169,616 B2Parent of this continuation · filed 9 Nov 2021
US 2023/0040703 A1Pre-grant publication · published 9 Feb 2023
US 11,487,364 B2Parent of this continuation
US 2019/0339784 A1Published application
US 2021/0011557 A1Published application
US 2022/0019292 A1Published application
US 11,907,436 B2This patent

From the US filing history. Foreign family members aren’t listed.

Timeline

Citations

Open elsewhere

Building an agent or pulling many patents? Use the API or MCP server instead of scraping pages. Get an API key