# US 10,375,800 B2 · Controlling a lighting system > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,375,800 B2 - Document ID: US10375800B2 - Status: Granted - Kind: B2 - Application number: 16/090,961 - Filed: 2017-04-04 - Published: 2019-04-18 - Granted: 2019-08-06 - Earliest claimed: 2016-04-06 - Assignees: Signify Holding B.V. - Applicants: Signify Holding B.V. - Inventors: Peter Deixler; Remco Magielse; Peter Rijskamp - Web page: https://patentgrep.com/patent/US10375800B2 ## CPC - H05B 45/20: Controlling the colour of the light - H05B 47/125: by using cameras - H05B 47/16: by timing means - H05B 47/19: via wireless transmission - H05B 47/196: {characterised by user interface arrangements} - H05B 47/1985: {Creation of lighting zones or scenes} - H05B 47/1965: {using handheld communication devices} - Y02B 20/40: Control techniques providing energy savings, e.g. smart controller or presence detection - H05B: ELECTRIC HEATING; ELECTRIC LIGHT SOURCES NOT OTHERWISE PROVIDED FOR; CIRCUIT ARRANGEMENTS FOR ELECTRIC LIGHT SOURCES, IN GENERAL - Y02B: CLIMATE CHANGE MITIGATION TECHNOLOGIES RELATED TO BUILDINGS, e.g. HOUSING, HOUSE APPLIANCES OR RELATED END-USER APPLICATIONS ## Abstract A method of controlling a lighting system comprising at least two luminaires arranged to illuminate a physical space, to render a version of a selected scene image. The method comprising: capturing at least one image of the physical space; using the captured at least one image to determine, for each of the luminaires, at least one location in the physical space associated with that luminaire; receiving a selection of a scene image to be rendered; processing the selected scene image to select at least two colors in the scene image and determining a respective location of each selected color in the scene image; comparing the determined scene image locations with the determined luminaire locations so as to identify, for each of the determined scene image locations, a matching one of the determined locations in the physical space; and controlling the luminaires to render the scene image, based on said comparison. ## Claims ### Claim 1 A method of controlling a lighting system, comprising at least two luminaires arranged to illuminate a physical space, to render a version of a selected scene image in the physical space, the method comprising the following steps: capturing with an imaging device at least one image of the physical space; using the captured of said at least one image to determine, for each of the at least two luminaires, at least one location in the physical space associated with said each of the two luminaires; receiving from a user the selected scene image to be rendered; processing the selected scene image to select at least two colors in the selected scene image for rendering, and determine a location of each of the selected at least two colors within the selected scene image; and comparing determined scene image locations with the determined luminaire locations so as to identify, for each of the determined scene image locations, a matching one of determined locations in the physical space, and controlling said each of the two luminaires associated with the at least one location in the physical space to emit illumination rendering a color at that scene image location, thereby causing the at least two luminaires to render the version of the selected scene image in the physical space. ### Claim 2 (depends on 1) The method according to claim 1, wherein, in the capturing step, multiple images are captured as a scanning motion is performed with the imaging device by the user, the method further comprising: combining the multiple images to generate a composite image covering a wider field of view than any of the multiple images individually, wherein locations in the physical space are determined from the composite image. ### Claim 3 (depends on 1) The method according to claim 1, wherein the selected scene image is: an additional image captured by the user with the imaging device, or a stored image retrieved from electronic storage when selected. ### Claim 4 (depends on 1) The method according to claim 1, further comprising: determining from the at least one image at least one illumination characteristic of an uncontrollable source of illumination in the physical space that is not part of the lighting system, wherein said each of the two luminaires are controlled to render the version of the selected scene image accounting for the uncontrollable illumination source based on its said determined of said at least one illumination characteristic. ### Claim 5 (depends on 4) The method according to claim 4, wherein the uncontrollable illumination source is a natural illumination source. ### Claim 6 (depends on 5) The method according to claim 5, wherein said at least one image is captured of the natural illumination source in an unobstructed state to capture daylight from it, which is processed to determine at least one daytime illumination characteristic thereof; and wherein at least one further image is captured of the natural illumination source in an obstructed state, which is processed to determine at least one night-time illumination characteristic thereof; wherein controlling step comprises determining a current time of day, and the version of the selected scene image is rendered accounting for the current time of day using the determined at least one daytime and/or at least one night-time illumination characteristic of the natural illumination source. ### Claim 7 (depends on 1) The method according to claim 1, wherein the at least two colors are selected in the selected scene image automatically. ### Claim 8 (depends on 1) The method according to claim 1, wherein the at least two colors are selected according to one or more color selection instructions received from the user via a user interface. ### Claim 9 (depends on 1) The method according to claim 1, wherein the at least one location associated with the at least one of the two luminaires is a location of that luminaire in the physical space or a location of an illumination footprint cast by that luminaire on a surface of the physical space. ### Claim 10 (depends on 1) The method according to claim 1, wherein for at least one of the at least two luminaires, the at least one captured image is also used to determine a shape and/or a size of: that luminaire and/or at least one illumination footprint cast by that luminaire on a surface of the physical space. ### Claim 11 (depends on 1) The method according to claim 1, wherein the at least two colors are selected by determining a color palette of an image, the color palette being a set of color identifiers corresponding to colors occurring in the selected scene image. ### Claim 12 (depends on 10) The method according to claim 10, wherein, for each color identified in a color palette, a scene image location for said each color is determined by identifying a region of the scene image location in which said each color is dominant, wherein said each of the at least two luminaires associated with locations in a matching region of the physical space are controlled to render said each color. ### Claim 13 (depends on 10) The method according claim 10, wherein a color palette is generated based on: respective frequencies at which different colors occur in an image, and/or at least one color capability of the at least two luminaires of the lighting system. ### Claim 14 (depends on 1) The computer program product comprising code stored on a computer readable storage medium and configured so as when executed to implement the method of claim 1. ### Claim 15 A lighting control apparatus for controlling a lighting system, the lighting system comprising at least two luminaires arranged to illuminate a physical space, the lighting control apparatus controlling the lighting system to render a version of a selected scene image in the physical space, the lighting control apparatus comprising: an image input configured to receive, from an imaging device at least one image of the physical space; an image processing module configured to use the captured at least one image to determine, for each of the at least two luminaires, at least one location in the physical space associated with said each of the at least two luminaires; a user interface configured to receive from a user a selection of a scene image to be rendered; a color selection module configured to process the selected scene image to select at least two colors in the scene image for rendering, and to determine a location of each of the selected at least two colors within the scene image; a color mapping module configured to compare determined scene image locations with the determined luminaire locations so as to identify, for each of the determined scene image locations, a matching one of the determined scene image locations in the physical space; and a control module configured to control the luminaire associated with that location in the physical space to emit illumination rendering a color at that scene image location, thereby causing the luminaires to render a version of the selected scene image in the physical space.