Home automation device control and designation
AssigneeApple Inc.
InventorsEddy Zexin LIANG, Xinze WANG, Madhu CHINTHAKUNTA, William CARUSO
Life of this patent
Estimating the term…
Abstract
Systems and processes for operating an intelligent automated digital assistant on an electronic device are provided. In particular, this paper describes how the intelligent automated digital assistant can be leveraged with other types of commands to control a household having multiple home automation devices. A portable electronic device is used to provide a user an extended reality environment within which the user can both managed and control the home automation devices.
Claims37
A method, comprising:
- at a portable electronic device:
- receiving a first user input indicating a location of an electronic device of one or more electronic devices separate from the portable electronic device and designation information for selecting the electronic device, wherein the first user input includes a voice input including the designation information;
- displaying the designation information for selecting the electronic device in a three dimensional space viewable using the portable electronic device;
- and
- after receiving the voice input, receiving a second input requesting a change in state of the electronic device.
(canceled)
A portable electronic device, comprising:
- one or more processors;
- a memory;
- and
- one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for:
- receiving a first user input indicating a location of an electronic device of one or more electronic devices separate from the portable electronic device and designation information for selecting the electronic device, wherein the first user input includes a voice input including the designation information;
- displaying the designation information for selecting the electronic device in a three dimensional space viewable using the portable electronic device;
- and
- after receiving the voice input, receiving a second input requesting a change in state of the electronic device.
The portable electronic device of claim 21, wherein the multimodal input comprises the voice input including the designation information and an inaudible input for identifying the location of the electronic device.
A non-transitory computer-readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by one or more processors of a portable electronic device, cause the portable electronic device to:
- receive a first user input indicating a location of an electronic device of one or more electronic devices separate from the portable electronic device and designation information for selecting the electronic device, wherein the first user input includes a voice input including the designation information;
- display the designation information for selecting the electronic device in a three dimensional space viewable using the portable electronic device;
- and
- after receiving the voice input, receive a second input requesting a change in state of the electronic device.
The non-transitory computer-readable storage medium of claim 29, wherein the multimodal input comprises the voice input including the designation information and an inaudible input for identifying the location of the electronic device.
Dependencies are inferred from the claim text.