# US 2016/0253552 A1 · Generating actions based on a user's mood

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2016/0253552 A1
- Document ID: US20160253552A1
- Status: Published application
- Kind: A1
- Application number: 15/054,587
- Filed: 2016-02-26
- Published: 2016-09-01
- Earliest claimed: 2015-02-27
- Assignees: Immersion Corporation
- Applicants: Immersion Corporation
- Inventors: William S. RIHN; Amaya Becvar WEDDLE; David M. BIRNBAUM
- Web page: https://patentgrep.com/patent/US20160253552A1

## CPC

- H04L 51/10: Multimedia information
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06F 3/015: {Input arrangements based on nervous system activity detection, e.g. brain waves [EEG] detection, electromyograms [EMG] detection, electrodermal response detection}
- G06F 3/016: {Input arrangements with force or tactile feedback as computer generated output to the user}
- G06F 3/0304: {Detection arrangements using opto-electronic means (constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042)}
- G06Q 10/107: Computer-aided management of electronic mailing [e-mailing]
- G06V 40/174: {Facial expression recognition}
- H04L 51/04: Real-time or near real-time messaging, e.g. instant messaging [IM]
- H04L 51/52: for supporting social networking services
- H04L 67/52: specially adapted for the location of the user terminal
- H04M 1/72436: for text messaging, e.g. short messaging services [SMS] or e-mails
- H04M 1/72454: according to context-related or environment-related conditions
- H04M 1/72457: according to geographic location
- H04W 4/029: Location-based management or tracking services
- G06F 2203/011: Emotion or mood input determined on the basis of sensed human body parameters such as pulse, heart rate or beat, temperature of skin, facial expressions, iris, voice pitch, brain activity patterns
- H04M 2250/12: including a sensor for measuring a physical value, e.g. temperature or motion
- H04M 2250/52: including functional features of a camera
- H04W 4/02: Services making use of location information
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- H04M: TELEPHONIC COMMUNICATION (circuits for controlling other apparatus via a telephone cable and not involving telephone switching apparatus G08)
- H04W: WIRELESS COMMUNICATION NETWORKS (broadcast communication H04H; communication systems using wireless links for non-selective communication, e.g. wireless extensions H04M1/72)

## Abstract

A system determines a mood of an associated user. Based on the determined mood, an action to be performed by the system is determined. The system then initiates the determined action by transmitting an object that corresponds to the determined mood to another system.

## Claims

### Claim 1

A method of operating an electronic device, the method comprising:
determining a mood of a user associated with a first electronic device;
determining an action to be performed by the first electronic device based on the determined mood; and
initiating the determined action, wherein the determined action comprises transmitting an object that corresponds to the determined mood to a second electronic device.

### Claim 2 (depends on 1)

The method of claim 1, wherein the determining the mood is based on a physical attribute of the user.

### Claim 3 (depends on 2)

The method of claim 2, wherein the physical attribute comprises facial cues of the user that is determined based on a camera on the electronic device.

### Claim 4 (depends on 2)

The method of claim 2, wherein the physical attribute comprises at least one of a sensed biomarker of the user, a voice of the user, or an input pressure applied by the user on the electronic device.

### Claim 5 (depends on 1)

The method of claim 1, wherein the determined action comprises automatically selecting and attaching the object comprising an emoticon or an electronic sticker to a message prepared by the user.

### Claim 6 (depends on 1)

The method of claim 1, wherein the determined action comprises automatically transmitting to a second electronic device at least one of a visual effect that reflects the determined mood, an audio effect that reflects the determined mood or a haptic effect that reflects the determined mood.

### Claim 7 (depends on 1)

The method of claim 1, wherein the determined action is further based on a location of the user.

### Claim 8 (depends on 5)

The method of claim 5, wherein the determined action further comprises modifying the emoticon or electronic sticker based on the determined mood.

### Claim 9

A computer readable medium having instructions stored thereon that, when executed by a processor, cause the processor to operate an electronic device, the operating comprising:
determining a mood of a user associated with a first electronic device;
determining an action to be performed by the first electronic device based on the determined mood; and
initiating the determined action, wherein the determined action comprises transmitting an object that corresponds to the determined mood to a second electronic device.

### Claim 10 (depends on 9)

The computer readable medium of claim 9, wherein the determining the mood is based on a physical attribute of the user.

### Claim 11 (depends on 10)

The computer readable medium of claim 10, wherein the physical attribute comprises facial cues of the user that is determined based on a camera on the electronic device.

### Claim 12 (depends on 10)

The computer readable medium of claim 10, wherein the physical attribute comprises at least one of a sensed biomarker of the user, a voice of the user, or an input pressure applied by the user on the electronic device.

### Claim 13 (depends on 9)

The computer readable medium of claim 9, wherein the determined action comprises automatically selecting and attaching the object comprising an emoticon or an electronic sticker to a message prepared by the user.

### Claim 14 (depends on 9)

The computer readable medium of claim 9, wherein the determined action comprises automatically transmitting to a second electronic device at least one of a visual effect that reflects the determined mood, an audio effect that reflects the determined mood or a haptic effect that reflects the determined mood.

### Claim 15 (depends on 9)

The computer readable medium of claim 9, wherein the determined action is further based on a location of the user.

### Claim 16 (depends on 13)

The computer readable medium of claim 13, wherein the determined action further comprises modifying the emoticon or electronic sticker based on the determined mood.

### Claim 17

An apparatus comprising:
a mood determiner that comprises a sensor and determines a mood of a user associated with the apparatus; and
an action determiner that comprises a transmitter and that determines an action to be performed by the apparatus based on the determined mood and initiates the determined action, wherein the determined action comprises transmitting an object that corresponds to the determined mood to a second apparatus.

### Claim 18 (depends on 17)

The apparatus of claim 17, wherein the determines the mood is based on a physical attribute of the user.

### Claim 19 (depends on 18)

The apparatus of claim 18, further comprising a camera, wherein the physical attribute comprises facial cues of the user that is determined using the camera.

### Claim 20 (depends on 18)

The apparatus of claim 18, wherein the physical attribute comprises at least one of a sensed biomarker of the user, a voice of the user, or an input pressure applied by the user on the apparatus.
