# US 2021/0342011 A1 · Gesture-based load control > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2021/0342011 A1 - Document ID: US20210342011A1 - Status: Published application - Kind: A1 - Application number: 17/378,315 - Filed: 2021-07-16 - Published: 2021-11-04 - Earliest claimed: 2013-03-15 - Assignees: Lutron Technology Company LLC - Applicants: Lutron Technology Company LLC - Inventors: Soumya Jain; Michael J. Zizza; John Nill - Web page: https://patentgrep.com/patent/US20210342011A1 ## CPC - G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)} - G05B 15/02: electric - G06T 7/20: Analysis of motion (motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51) - G06T 7/73: using feature-based methods - H04N 13/204: using stereoscopic image cameras (stereoscopic photography G03B35/00) - H04N 23/95: Computational photography systems, e.g. light-field imaging systems - H04N 23/20: for generating image signals from infrared radiation only - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G05B: CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS (systems for controlling or regulating non-electric variables G05D; systems for regulating electric or magnetic variables G05F; control devices or systems insofar as characterised by mechanical features only G05G) - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract A load control system may include load control devices for controlling an amount of power provided to an electrical load. The load control devices may be capable of controlling the amount of power provided to the electrical load based on control instructions received from a gesture-based control device. The gesture-based control device may identify gestures performed by a user for controlling a load control device and provide control instructions to the load control device based on the identified gestures. The gestures may be identified based on images received from a motion capture device. A gesture may be associated with a scene that includes a configuration of one or more load control devices in a load control system. The user may perform one or more gestures to program the gesture-based control device to identify a gesture. ## Claims ### Claim 1 A controller to control an amount of power provided to each of a plurality of electrical load devices included in each of a plurality of scenes, the controller comprising: image acquisition circuitry; memory circuitry; and control circuitry communicatively coupled to the image acquisition circuitry and to the memory circuitry, the control circuitry to: identify a user in a space using the image acquisition circuitry; determine a unique identifier associated with the user; and retrieve data representative of one or more user-specific scenes associated with the space and with the unique identifier, wherein the one or more retrieved scenes include one or more user-specific electrical load control gestures associated with the unique identifier. ### Claim 2 (depends on 1) The controller of claim 1 wherein to identify the user in the space, the control circuitry to further: identify the user in the space based on a skeletal outline using one or more images captured via the image acquisition circuitry. ### Claim 3 (depends on 1) The controller of claim 1 wherein to identify the user in the space, the control circuitry to further: identify the user in the space based on facial recognition using one or more images captured via the image acquisition circuitry. ### Claim 4 (depends on 1) The controller of claim 1 wherein to retrieve the data representative of the one or more user-specific scenes associated with the space and with the unique identifier, the control circuitry to further: retrieve data representative of the one or more user-specific scenes associated with the space and with the unique identifier wherein the one or more retrieved scenes include one or more user-specific electrical load control gestures and one or more user-specific commands associated with the unique identifier. ### Claim 5 (depends on 1) The controller of claim 1 wherein to identify the user in the space, the control circuitry to further: identify one or more gestures provided by the user; determine whether the user has indicated a change to an individual electrical load or to a change in the electrical loads included in a current user-specific scene; and responsive to a determination that the user has indicated a change in the electrical loads included in the current user-specific scene, communicate one or more instructions to each of the electrical loads included in the current user-specific scene. ### Claim 6 A method to control an amount of power provided to each of a plurality of electrical load devices included in each of a plurality of scenes, the method comprising: identifying, by electrical load control circuitry, a user in a space via image acquisition circuitry communicatively coupled to the electrical load control circuitry; determining, by the electrical load control circuitry, a unique identifier associated with the user; and retrieving, by the electrical load control circuitry from communicatively coupled memory circuitry, data representative of one or more user-specific scenes associated with the space and with the unique identifier, wherein the one or more retrieved scenes include one or more user-specific electrical load control gestures associated with the unique identifier. ### Claim 7 (depends on 6) The method of claim 6 wherein identifying the user in the space further comprises: identifying, by the electrical load control circuitry, the user in the space based on a skeletal outline using one or more images captured via the image acquisition circuitry. ### Claim 8 (depends on 6) The method of claim 6 wherein identifying the user in the space further comprises: identifying, by the electrical load control circuitry, the user in the space based on facial recognition using one or more images captured via the image acquisition circuitry. ### Claim 9 (depends on 6) The method of claim 6 wherein retrieving the data representative of the one or more user-specific scenes associated with the space and with the unique identifier further comprises: retrieving, by the electrical load control circuitry from communicatively coupled memory circuitry, data representative of the one or more user-specific scenes associated with the space and with the unique identifier wherein the one or more retrieved scenes include one or more user-specific electrical load control gestures and one or more user-specific commands associated with the unique identifier. ### Claim 10 (depends on 6) The method of claim 6 wherein identifying the user in the space further comprising: identifying, by the electrical load control circuitry via the communicatively coupled image acquisition circuitry, one or more gestures provided by the user; determining, by the electrical load control circuitry, whether the user has indicated a change to an individual electrical load or to a change in the electrical loads included in a current user-specific scene; and responsive to a determination that the user has indicated a change in the electrical loads included in the current user-specific scene, communicating, by the electrical load control circuitry, one or more instructions to each of the electrical loads included in the current user-specific scene. ### Claim 11 A non-transitory, machine-readable, storage device that includes instructions that, when executed by an electrical load control circuit, cause the electrical load control circuit to: control an amount of power provided to each of a plurality of electrical load devices included in each of a plurality of scenes; identify a user in a space via image acquisition circuitry communicatively coupled to the electrical load control circuitry; determine a unique identifier associated with the user; and retrieve, from communicatively coupled memory circuitry, data representative of one or more user-specific scenes, each of the scenes including a plurality of electrical load devices, associated with the space and with the unique identifier, wherein the one or more retrieved scenes include one or more user-specific electrical load control gestures associated with the unique identifier. ### Claim 12 (depends on 11) The non-transitory, machine-readable, storage device of claim 11 wherein the instructions that cause the electrical load control circuit to identify the user in the space further cause the electrical load control circuit to: identify the user in the space based on a skeletal outline using one or more images captured via the image acquisition circuitry. ### Claim 13 (depends on 11) The non-transitory, machine-readable, storage device of claim 11 wherein the instructions that cause the electrical load control circuit to identify the user in the space further cause the electrical load control circuit to: identify the user in the space based on facial recognition using one or more images captured via the image acquisition circuitry. ### Claim 14 (depends on 11) The non-transitory, machine-readable, storage device of claim 11 wherein the instructions that cause the electrical load control circuit to retrieve the data representative of the one or more user-specific scenes associated with the space and with the unique identifier further cause the electrical load control circuit to: retrieve, from communicatively coupled memory circuitry, data representative of the one or more user-specific scenes associated with the space and with the unique identifier wherein the one or more retrieved scenes include one or more user-specific electrical load control gestures and one or more user-specific commands associated with the unique identifier. ### Claim 15 (depends on 11) The non-transitory, machine-readable, storage device of claim 11 wherein the instructions that cause the electrical load control circuit to identify the user in the space further cause the electrical load control circuit to: identify, via the communicatively coupled image acquisition circuitry, one or more gestures provided by the user; determine whether the user has indicated a change to an individual electrical load or to a change in the electrical loads included in a current user-specific scene; and responsive to a determination that the user has indicated a change in the electrical loads included in the current user-specific scene, communicate one or more instructions to each of the electrical loads included in the current user-specific scene.