# US 10,310,725 B2 · Generating scenes based on accessory state

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,310,725 B2
- Document ID: US10310725B2
- Status: Granted
- Kind: B2
- Application number: 15/275,339
- Filed: 2016-09-24
- Published: 2017-12-14
- Granted: 2019-06-04
- Earliest claimed: 2016-06-12
- Assignees: Apple Inc.
- Applicants: Apple Inc.
- Inventors: Benjamin A. Smith; Reed Olsen; Kevin McLaughlin; Anush Nadathur
- Web page: https://patentgrep.com/patent/US10310725B2

## CPC

- G06F 3/04847: Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
- G05B 15/02: electric
- G06F 3/0482: Interaction with lists of selectable items, e.g. menus
- G06F 3/04883: for inputting data by handwriting, e.g. gesture or text
- H04L 12/2816: {Controlling appliance services of a home automation network by calling their functionalities (arrangements in telecontrol or telemetry systems for selectively calling a substation from a main station; in which substation desired apparatus is selected for applying a control signal thereto or for obtaining measured values therefrom H04Q9/00)}
- H04L 12/282: {based on user interaction within the home (receiver circuitry for displaying additional information being controlled by a remote control apparatus H04N21/42204)}
- G05B 2219/2642: Domotique, domestic, home control, automation, smart house
- H04W 4/80: Services using short range communication, e.g. near-field communication [NFC], radio-frequency identification [RFID] or low energy communication
- H04W 88/08: Access point devices
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G05B: CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS (systems for controlling or regulating non-electric variables G05D; systems for regulating electric or magnetic variables G05F; control devices or systems insofar as characterised by mechanical features only G05G)
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)
- H04W: WIRELESS COMMUNICATION NETWORKS (broadcast communication H04H; communication systems using wireless links for non-selective communication, e.g. wireless extensions H04M1/72)

## Abstract

In some implementations, a computing device can automatically generate a scene. For example, a scene can be a collection of accessories and corresponding accessory states. When the scene is invoked, the computing device can cause the accessories associated with the scene to assume the corresponding accessory states. The computing device can automatically determine the accessories and/or corresponding accessory states for a scene based on historical patterns of use represented in historical accessory state data. The computing device can generate a scene based on a snapshot of current accessory states for the accessories associated with the scene.

## Claims

### Claim 1

A method comprising:
automatically determining, by a computer device, a plurality of accessories to include in a scene based at least in part on accessory state change data indicating that the plurality of accessories were a most recent group of accessories to change state within a time period of each other;
generating, by the computing device, the scene based at least in part on the automatically determined accessories, the scene including the plurality of accessories and corresponding scene settings, wherein each of the accessories has at least one corresponding scene setting;
assigning, by the computing device, the current state of each of the accessories as the scene setting for the corresponding accessory;
receiving, by the computing device, user input selecting a representation of the scene presented on a graphical user interface of the computing device; and
in response to receiving the user input, causing, by the computing device, each of the plurality of accessories associated with the scene to transition to the state identified by the scene setting for each respective accessory associated with the scene.

### Claim 2 (depends on 1)

The method of claim 1, wherein causing each of the plurality of accessories associated with the scene to transition to the state identified by the scene setting for each respective accessory associated with the scene comprises:
sending a message to each of the plurality of accessories that instructs each accessory to transition to the state identified by the scene settings for the respective accessory.

### Claim 3 (depends on 1)

The method of claim 1, wherein determining a current state of each of the accessories comprises:
determining the current state of each of the accessories at a time when the scene is generated.

### Claim 4 (depends on 1)

The method of claim 1, further comprising:
receiving user input instructing the computing device to generate the scene;
automatically determining accessories to include in the scene based on historical patterns of use determined based on historical accessory state change data; and
generating the scene based on the automatically determined accessories.

### Claim 5 (depends on 1)

The method of claim 1, further comprising:
receiving a first user input instructing the computing device to generate the scene; receiving a second user input selecting accessories to include in the scene; and generating the scene based on the user selected accessories; and
automatically configuring the scene settings for each accessory based on the current state of each of the selected accessories at a time when the first user input was received.

### Claim 6 (depends on 1)

The method of claim 1, further comprising:
receiving user input instructing the computing device to generate the scene;
automatically determining the plurality of accessories to include in the scene based on accessory state change data indicating that the accessories have changed state within a period of time prior to receiving the user input; and
generating the scene based on the automatically determined accessories.

### Claim 7

A non-transitory computer-readable medium including one or more sequences of instructions that, when executed by one or more processors, cause:
automatically determining, by a computer device, a plurality of accessories to include in a scene based at least in part on accessory state change data indicating that the plurality of accessories were a most recent group of accessories to change state within a time period of each other;
generating, by the computing device, the scene based at least in part on the automatically determined accessories, the scene including the plurality of accessories and corresponding scene settings, wherein each of the accessories has at least one corresponding scene setting;
determining, by the computing device, a current state of each of the accessories associated with the scene;
assigning, by the computing device, the current state of each of the accessories as the scene setting for the corresponding accessory;
receiving, by the computing device, user input selecting a representation of the scene presented on a graphical user interface of the computing device; and
in response to receiving the user input, causing, by the computing device, each of the plurality of accessories associated with the scene to transition to the state identified by the scene setting for each respective accessory associated with the scene.

### Claim 8 (depends on 7)

The non-transitory computer-readable medium of claim 7, wherein the instructions that cause causing each of the plurality of accessories associated with the scene to transition to the state identified by the scene setting for each respective accessory associated with the scene include instructions that cause:
sending a message to each of the plurality of accessories that instructs each accessory to transition to the state identified by the scene settings for the respective accessory.

### Claim 9 (depends on 7)

The non-transitory computer-readable medium of claim 7, wherein the instructions that cause determining a current state of each of the accessories include instructions that cause:
determining the current state of each of the accessories at a time when the scene is generated.

### Claim 10 (depends on 7)

The non-transitory computer-readable medium of claim 7, where the instructions cause:
receiving user input instructing the computing device to generate the scene;
automatically determining accessories to include in the scene based on historical patterns of use determined based on historical accessory state change data; and
generating the scene based on the automatically determined accessories.

### Claim 11 (depends on 7)

The non-transitory computer-readable medium of claim 7, where the instructions cause:
receiving a first user input instructing the computing device to generate the scene;
receiving a second user input selecting accessories to include in the scene; and
generating the scene based on the user selected accessories; and
automatically configuring the scene settings for each accessory based on the current state of each of the selected accessories at a time when the first user input was received.

### Claim 12 (depends on 7)

The non-transitory computer-readable medium of claim 7, where the instructions cause:
receiving user input instructing the computing device to generate the scene;
automatically determining the plurality of accessories to include in the scene based on accessory state change data indicating that the accessories have changed state within a period of time prior to receiving the user input; and
generating the scene based on the automatically determined accessories.

### Claim 13

A system comprising:
one or more processors; and
a non-transitory computer-readable medium including one or more sequences of instructions that, when executed by one or more processors, cause:
automatically determining, by a computer device, a plurality of accessories to include in a scene based at least in part on accessory state change data indicating that the plurality of accessories were a most recent group of accessories to change state within a time period of each other;
generating, by the computing device, the scene based at least in part on the automatically determined accessories, the scene including the plurality of accessories and corresponding scene settings, wherein each of the accessories has at least one corresponding scene setting;
determining, by the computing device, a current state of each of the accessories associated with the scene;
assigning, by the computing device, the current state of each of the accessories as the scene setting for the corresponding accessory;
receiving, by the computing device, user input selecting a representation of the scene presented on a graphical user interface of the computing device; and
in response to receiving the user input, causing, by the computing device, each of the plurality of accessories associated with the scene to transition to the state identified by the scene setting for each respective accessory associated with the scene.

### Claim 14 (depends on 13)

The system of claim 13, wherein the instructions that cause causing each of the plurality of accessories associated with the scene to transition to the state identified by the scene setting for each respective accessory associated with the scene include instructions that cause:
sending a message to each of the plurality of accessories that instructs each accessory to transition to the state identified by the scene settings for the respective accessory.

### Claim 15 (depends on 13)

The system of claim 13, wherein the instructions that cause determining a current state of each of the accessories include instructions that cause:
determining the current state of each of the accessories at a time when the scene is generated.

### Claim 16 (depends on 13)

The system of claim 13, where the instructions cause:
receiving user input instructing the computing device to generate the scene;
automatically determining accessories to include in the scene based on historical patterns of use determined based on historical accessory state change data; and
generating the scene based on the automatically determined accessories.

### Claim 17 (depends on 13)

The system of claim 13, where the instructions cause:
receiving a first user input instructing the computing device to generate the scene;
receiving a second user input selecting accessories to include in the scene; and
generating the scene based on the user selected accessories; and
automatically configuring the scene settings for each accessory based on the current state of each of the selected accessories at a time when the first user input was received.

### Claim 18 (depends on 13)

The system of claim 13, where the instructions cause:
receiving user input instructing the computing device to generate the scene;
automatically determining the plurality of accessories to include in the scene based on accessory state change data indicating that the accessories have changed state within a period of time prior to receiving the user input; and
generating the scene based on the automatically determined accessories.