# US 9,427,666 B2 · Gaming scheme using general mood information

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 9,427,666 B2
- Document ID: US9427666B2
- Status: Granted
- Kind: B2
- Application number: 15/014,072
- Filed: 2016-02-03
- Published: 2016-05-26
- Granted: 2016-08-30
- Earliest claimed: 2016-02-03
- Assignees: Empire Technology Development LLC
- Applicants: Empire Technology Development LLC
- Inventors: Takahiro Miyashita; Satoru Satake; Masahiro Shiomi
- Web page: https://patentgrep.com/patent/US9427666B2

## CPC

- A63F 13/10
- A63F 13/355: Performing operations on behalf of clients with restricted processing capabilities, e.g. servers transform changing game scene into an encoded video stream for transmitting to a mobile phone or a thin client
- A63F 13/12
- A63F 13/213: comprising photodetecting means, e.g. cameras, photodiodes or infrared cells (A63F13/219 takes precedence)
- A63F 13/216: using geographical information, e.g. location of the game device or player using GPS
- A63F 13/23: for interfacing with the game device, e.g. specific interfaces between game controller and console
- A63F 13/30: Interconnection arrangements between game servers and game devices; Interconnection arrangements between game devices; Interconnection arrangements between game servers
- A63F 13/45: Controlling the progress of the video game
- A63F 13/46: Computing the game score
- A63F 13/52: involving aspects of the displayed game scene
- A63F 13/65: automatically by game devices or servers from real world data, e.g. measurement in live racing competition
- A63F 13/822: Strategy games; Role-playing games (A63F13/825, A63F13/828 take precedence)
- A63F 13/95: Storage media specially adapted for storing game information, e.g. video game cartridges
- A63F 2300/1093: using visible light
- A63F 2300/535: for monitoring, e.g. of user parameters, terminal parameters, application parameters, network parameters
- A63F 2300/5546: using player registration data, e.g. identification, account, preferences, game history
- A63F 2300/6045: for mapping control signals received from the input arrangement into game commands
- A63F: CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR

## Abstract

Technologies are generally described for a general mood adding scheme in a cloud-based game system. In some examples, a method performed under control of a computing device may include receiving from a raw database at least one set of facial expression data, each of the at least one set of facial expression data being accompanied by time information and location information, clustering a geographic area to form at least one cluster based at least in part on the at least one set of facial expression data, and storing the at least one cluster in a map database corresponding to the area.

## Claims

### Claim 1

A non-transitory computer-readable storage medium having stored thereon computer-executable instructions that, in response to execution, cause one or more processor to perform operations, comprising:
receiving at least one set of facial expression data and at least one external factor including at least one of population density, weather conditions or event information, each of the at least one set of facial expression data being accompanied by time information and location information and being obtained from at least one image, the at least one image being captured by a camera;
clustering a geographic area to form at least one cluster corresponding to general mood information determined based at least in part on the at least one set of facial expression data;
storing the at least one cluster and the at least one external factor in a map database corresponding to the geographic area;
obtaining a correlation between the at least one cluster and the at least one external factor; and
based on the obtained correlation, attaching information regarding how the general mood information changes according to the at least one external factor to the map database.

### Claim 2 (depends on 1)

The non-transitory computer-readable storage medium of claim 1, wherein the map database is a cloud datacenter and is periodically updated.

### Claim 3 (depends on 1)

The non-transitory computer-readable storage medium of claim 1, wherein the clustering includes a spatiotemporal clustering, and each of the at least one cluster includes temporal information and spatial information within the geographic area.

### Claim 4 (depends on 3)

The non-transitory computer-readable storage medium of claim 3, wherein the storing includes attaching each of the at least one cluster to the map database based at least in part on the temporal information and the spatial information.

### Claim 5 (depends on 4)

The non-transitory computer-readable storage medium of claim 4, wherein the operations further comprise:
determining a time and a location at which an actual position-based game is played; and
based on the determined time and location, determining the general mood information for the actual position-based game from the map database.

### Claim 6 (depends on 5)

The non-transitory computer-readable storage medium of claim 5, wherein the actual position-based game is a treasure-hunting game and the determined general mood information is used by a player of the treasure-hunting game to determine whether to ask a passersby at the location when the treasure-hunting game is played.

### Claim 7 (depends on 6)

The non-transitory computer-readable storage medium of claim 6, wherein the determined general mood information is further used to determine scores for the game player.

### Claim 8 (depends on 6)

The non-transitory computer-readable storage medium of claim 6, wherein the determined general mood information is further used to determine a place to hide the treasure.

### Claim 9 (depends on 1)

The non-transitory computer-readable storage medium of claim 1, wherein the general mood information includes delight, anger, sorrow, joy, shock, fear, abomination, neutrality, or indifference.

### Claim 10 (depends on 1)

The non-transitory computer-readable storage medium of claim 1, wherein the at least one set of facial expression data is obtained from the at least one image captured by the camera based on positions or forms of eyebrows, eyes or a mouth.

### Claim 11 (depends on 3)

The non-transitory computer-readable storage medium of claim 3, wherein the spatiotemporal clustering includes an ISODATA (Iterative Self-Organizing Data Analysis Technique Algorithm) or K-means clustering.

### Claim 12

A computing device, comprising:
at least one processor configured to:
receive at least one set of facial expression data and at least one external factor including at least one of population density, weather conditions or event information, each of the at least one set of facial expression data being accompanied by time information and location information, wherein the each of the at least one set of facial expression data is obtained from at least one image captured by a camera, and
spatiotemporally cluster a geographic area to form at least one cluster corresponding to general mood information determined based at least in part on the at least one set of facial expression data; and
a storing unit configured to:
store the at least one cluster and the at least one external factor in a map database corresponding to the geographic area,
obtain a correlation between the at least one cluster and the at least one external factor, and
based on the obtained correlation, attach information regarding how the general mood information changes according to the at least one external factor to a map of the geographic area stored in the map database.

### Claim 13 (depends on 12)

The computing device of claim 12, wherein the at least one external factor is obtained by a sensor configured to measure external factors of the geographic area.

### Claim 14 (depends on 13)

The computing device of claim 13, wherein the population density is obtained by the sensor which comprises a headcount device that utilizes infrared light.

### Claim 15 (depends on 13)

The computing device of claim 13, wherein the weather conditions are obtained by the sensor which comprises a weather sensor for measuring illuminance, temperature, humidity, or atmospheric pressure.

### Claim 16 (depends on 13)

The computing device of claim 13, wherein the event information is obtained by the sensor which comprises an input device that enables people to input the event information.

### Claim 17

A system, comprising:
a computing device comprising:
at least one processor configured to:
receive from a cloud datacenter at least one set of facial expression data and at least one external factor including at least one of population density, weather conditions or event information, each of the at least one set of facial expression data being accompanied by time information and location information, and
spatiotemporally cluster a geographic area to form at least one cluster corresponding to general mood information determined based at least in part on the at least one set of facial expression data; and
a storing unit configured to:
store the at least one cluster and the at least one external factor in the cloud datacenter corresponding to the geographic area,
obtain a correlation between the at least one cluster and the at least one external factor, and
based on the obtained correlation, attach information of how the general mood information changes according to the at least one external factor to a map of the geographic area stored in the cloud datacenter; and
the cloud datacenter configured to:
transmit, to the computing device, the at least one set of facial expression data including the time information and the location information and the at least one external factor, wherein the each of the at least one set of facial expression data is obtained from at least one image captured by a camera, and
store the map of the geographic area.

### Claim 18 (depends on 17)

The system of claim 17, wherein the cloud datacenter is further configured to update the map of the geographic area periodically.

### Claim 19 (depends on 17)

The system of claim 17, wherein the map of the geographic area including the information of how the general mood information changes according to the at least one external factor is used for a cloud-based game.

### Claim 20 (depends on 17)

The system of claim 17, wherein the cloud datacenter is further configured to:
receive the at least one image from the camera installed in the fixed geographical area; and
receive the at least one external factor from a sensor installed in the fixed geographical area.
