# US 2018/0295317 A1 · Intelligent Dynamic Ambient Scene Construction

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2018/0295317 A1
- Document ID: US20180295317A1
- Status: Published application
- Kind: A1
- Application number: 15/484,863
- Filed: 2017-04-11
- Published: 2018-10-11
- Earliest claimed: 2017-04-11
- Assignees: Motorola Mobility LLC
- Applicants: Motorola Mobility LLC
- Inventors: Vivek Tyagi; Sudhir Vissa
- Web page: https://patentgrep.com/patent/US20180295317A1

## CPC

- H04N 21/44218: {Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV programme (methods or arrangements for recognising human body or animal bodies or body parts G06V40/10; methods or arrangements for acquiring or recognising human faces, facial parts, facial sketches, facial expressions G06V40/16; methods or arrangements for recognising movements or behaviour G06V40/20; arrangements for identifying users in broadcast systems H04H60/45)}
- H05B 47/155: Coordinated control of two or more light sources
- G11B 27/031: Electronic editing of digitised analogue information signals, e.g. audio or video signals
- G11B 27/32: on separate auxiliary tracks of the same or an auxiliary record carrier
- H04N 9/8205: {involving the multiplexing of an additional signal and the colour video signal}
- H04N 21/23614: {Multiplexing of additional data and video streams (arrangements for simultaneous broadcast of plural pieces of information H04H20/28)}
- G11B 27/34: Indicating arrangements {(indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D)}
- H04N 21/4131: {home appliance, e.g. lighting, air conditioning system, metering devices (home automation data switching networks exchanging configuration information on appliance services H04L12/2807)}
- Y02B 20/40: Control techniques providing energy savings, e.g. smart controller or presence detection
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- H05B: ELECTRIC HEATING; ELECTRIC LIGHT SOURCES NOT OTHERWISE PROVIDED FOR; CIRCUIT ARRANGEMENTS FOR ELECTRIC LIGHT SOURCES, IN GENERAL
- G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R)
- Y02B: CLIMATE CHANGE MITIGATION TECHNOLOGIES RELATED TO BUILDINGS, e.g. HOUSING, HOUSE APPLIANCES OR RELATED END-USER APPLICATIONS

## Abstract

Systems and methods for controlling ambient lighting at a playback location during media playback entail generating an ambient light map for controlling ambient lighting in synchrony with the media during playback of the media. The ambient light map includes lighting directions as well as a time stamp or other facility for synchronizing execution of the lighting directions with the playback of the media. For intensity-only lighting, a grayscale ambient light map may be used. Other sensory inputs may also be controlled, such as scent, temperature and tactile input. Moreover, the user mood may be detected and may then be used to modify the ambient light map.

## Claims

### Claim 1

A method of transferring media content having an audio portion and a video portion comprising:
encoding the audio portion of the media content;
encoding the video portion of the media content;
generating a first ambient light map and a second ambient light map for controlling ambient lighting in synchrony with the media during playback of the media, the first ambient light map specifying light color and light intensity and the second ambient light map being a grayscale map specifying only light intensity; and
packaging the encoded audio portion, the encoded video portion and the ambient light maps in a transferrable package and transferring the package.

### Claim 2

(canceled)

### Claim 3

(canceled)

### Claim 4 (depends on 1)

The method in accordance with claim 1, wherein generating the second ambient light map specifying only light intensity comprises generating the second map based on light color and light intensity values in the first map.

### Claim 5 (depends on 1)

The method in accordance with claim 1, further comprising generating a temperature map for controlling ambient temperature in synchrony with the media during playback of the media, and wherein packaging further comprises packaging the temperature map in the transferrable package.

### Claim 6 (depends on 1)

The method in accordance with claim 1, further comprising generating a sense map for controlling ambient sense stimulants in synchrony with the media during playback of the media, wherein the ambient sense stimulants include at least one of a scent stimulant and a tactile stimulant.

### Claim 7 (depends on 1)

The method in accordance with claim 1, wherein the ambient light maps include one or more timestamps to synchronize values in the ambient light maps to points of time in the media during playback.

### Claim 8 (depends on 1)

The method in accordance with claim 1, further comprising generating the ambient light maps based on a technical content of the media.

### Claim 9 (depends on 1)

The method in accordance with claim 1, further comprising generating the ambient light maps based on a substantive content of the media.

### Claim 10

A method of playing media content at a playback location comprising:
receiving a media content package, the media content package including an audio portion, a video portion and an ambient light map portion, wherein the ambient light map portion is time-synchronized with the audio portion and the video portion and includes a first part and a second part, wherein the first part specifies a light color and a light intensity and the second part is a grayscale ambient light map;
decoding the audio portion and the video portion of the media content package;
selecting one of the first part and the second part;
generating lighting instructions based on the selected part ambient light map; and
playing back the decoded audio and video portions while transmitting the lighting instructions to one or more ambient light fixtures at the playback location to control ambient lighting in synchrony with the played back audio and video portions.

### Claim 11 (depends on 10)

The method in accordance with claim 10, further comprising determining a viewer mood, and wherein generating lighting instructions based on the selected part comprises generating lighting instructions based on both the selected part and the determined viewer mood.

### Claim 12 (depends on 11)

The method in accordance with claim 11, wherein determining a viewer mood comprises predicting a viewer mood based on previously collected data from multiple users and refining the predicted viewer mood based on an analysis of image data of the viewer.

### Claim 13 (depends on 10)

The method in accordance with claim 10, further comprising detecting a viewer position within the playback location, and wherein generating lighting instructions based on the selected part comprises generating lighting instructions based on both the selected part and the detected viewer position.

### Claim 14

(canceled)

### Claim 15

(canceled)

### Claim 16 (depends on 10)

The method in accordance with claim 10, wherein the grayscale ambient light map is based on light color and light intensity values in the first part.

### Claim 17 (depends on 10)

The method in accordance with claim 10, wherein the media content package further comprises a sense map for controlling ambient sense stimulants in synchrony with the media during playback of the media, wherein the ambient sense stimulants include at least one of a temperature, a scent and a tactile stimulant.

### Claim 18 (depends on 10)

The method in accordance with claim 10, wherein the media content package further includes one or more timestamps to synchronize values in the first and second parts to points of time in the media during playback.

### Claim 19

A method of controlling ambient lighting in a playback location comprising:
receiving media data and an ambient light map, the ambient light map specifying desired ambient lighting correlated with the received media data;
determining that one or more controllable ambient lighting fixtures is present in the playback location and determining that the one or more present controllable ambient lighting fixtures are controllable with respect to one of intensity alone and intensity and color;
modifying the ambient light map by converting any colored values into grayscale values if it is determined that the one or more present controllable ambient lighting fixtures are controllable with respect to intensity alone;
generating lighting instructions based on the ambient light map; and
transmitting the generated lighting instructions to the one or more present controllable ambient lighting fixtures.

### Claim 20 (depends on 19)

The method in accordance with claim 19, further comprising detecting a viewer mood, and wherein modifying the ambient light map further comprises modifying the ambient light map based on the detected viewer mood.
