Back to results
US 2023/0409179 A1Published application
Home automation device control and designation
AssigneeApple Inc.
InventorsEddy Zexin LIANG, Xinze WANG, Madhu CHINTHAKUNTA, William CARUSO
Life of this patent
Estimating the term…
Abstract
Systems and processes for operating an intelligent automated digital assistant on an electronic device are provided. In particular, this paper describes how the intelligent automated digital assistant can be leveraged with other types of commands to control a household having multiple home automation devices. A portable electronic device is used to provide a user an extended reality environment within which the user can both manage and control the home automation devices.
Claims46
A method, comprising:
- at a portable electronic device:
- displaying designators for a plurality of home automation devices in a three dimensional space viewable using the portable electronic device, wherein the plurality of home automation devices share a geographical area with the portable electronic device;
- detecting a first input selecting a home automation device of the plurality of home automation devices;
- in response to receiving the first input, displaying a visual indicium within the three dimensional space, wherein the visual indicium represents a current state of the home automation device, and wherein the display of the visual indicium occupies a first area;
- receiving a hand gesture input performed by a hand, wherein the hand gesture input requests a change in the current state of the home automation device;
- in response to receiving the hand gesture input, displaying an overlay within the three dimensional space, wherein at least a portion of the overlay occupies a second area different from the first area, and wherein the overlay includes a description of a parameter to be adjusted by the hand gesture input;
- while displaying the overlay:
- detecting movement of the hand;
- and
- updating, based on the movement of the hand, the visual indicium to represent the requested change in the current state of the home automation device;
- and
- transmitting a control signal directing the requested change in the current state of the home automation device.
9 more elements
(canceled)
A portable electronic device, comprising:
- one or more processors;
- a memory;
- and
- one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for:
- displaying designators for a plurality of home automation devices in a three dimensional space viewable using the portable electronic device, wherein the plurality of home automation devices share a geographical area with the portable electronic device;
- detecting a first input selecting a home automation device of the plurality of home automation devices;
- in response to receiving the first input, displaying a visual indicium within the three dimensional space, wherein the visual indicium represents a current state of the home automation device, and wherein the display of the visual indicium occupies a first area;
- receiving a hand gesture input performed by a hand, wherein the hand gesture input requests a change in the current state of the home automation device;
- in response to receiving the hand gesture input, displaying an overlay within the three dimensional space, wherein at least a portion of the overlay occupies a second area different from the first area, and wherein the overlay includes a description of a parameter to be adjusted by the hand gesture input;
- while displaying the overlay:
- detecting movement of the hand;
- and
- updating, based on the movement of the hand, the visual indicium to represent the requested change in the current state of the home automation device;
- and
- transmitting a control signal directing the requested change in the current state of the home automation device.
12 more elements
A non-transitory computer-readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by one or more processors of a portable electronic device, cause the portable electronic device to:
- display designators for a plurality of home automation devices in a three dimensional space viewable using the portable electronic device, wherein the plurality of home automation devices share a geographical area with the portable electronic device;
- detect a first input selecting a home automation device of the plurality of home automation devices;
- in response to receiving the first input, display a visual indicium within the three dimensional space, wherein the visual indicium represents a current state of the home automation device, and wherein the display of the visual indicium occupies a first area;
- receive a hand gesture input performed by a hand, wherein the hand gesture input requests a change in the current state of the home automation device;
- in response to receiving the hand gesture input, display an overlay within the three dimensional space, wherein at least a portion of the overlay occupies a second area different from the first area, and wherein the overlay includes a description of a parameter to be adjusted by the hand gesture input;
- while displaying the overlay:
- detect movement of the hand;
- and
- update, based on the movement of the hand, the visual indicium to represent the requested change in the current state of the home automation device;
- and
- transmit a control signal directing the requested change in the current state of the home automation device.
8 more elements
(canceled)
(canceled)
Dependencies are inferred from the claim text.