# US 2019/0246233 A1 · Emoji that Indicates a Location of Binaural Sound

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0246233 A1
- Document ID: US20190246233A1
- Status: Published application
- Kind: A1
- Application number: 16/354,184
- Filed: 2019-03-15
- Published: 2019-08-08
- Earliest claimed: 2018-02-05
- Inventors: Philip Scott Lyren
- Web page: https://patentgrep.com/patent/US20190246233A1

## CPC

- H04S 7/303: {Tracking of listener position or orientation}
- G06F 3/147: using display panels
- G06F 3/165: {Management of the audio stream, e.g. setting of volume, audio stream path}
- G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback}
- G06T 13/40: of characters, e.g. humans, animals or virtual beings
- G09G 5/10: Intensity circuits
- G09G 5/37: Details of the operation on graphic patterns (G09G5/38 takes precedence)
- H04M 1/724: User interfaces specially adapted for cordless or mobile telephones
- H04M 1/7243: with interactive means for internal management of messages
- H04M 1/72442: for playing music files
- H04S 3/008: {in which the audio signals are in digital form, i.e. employing more than two discrete digital channels (data reduction aspects thereof based on psychoacoustics G10L19/02)}
- H04S 7/302: {Electronic adaptation of stereophonic sound system to listener position or orientation (H04S7/301 takes precedence)}
- G09G 5/38: with means for controlling the display position
- G09G 2354/00: Aspects of interface with display user
- G09G 2380/06: Remotely controlled electronic signs other than labels
- H04M 1/6008: {in the transmitter circuit}
- H04S 2400/11: Positioning of individual sound objects, e.g. moving airplane, within a sound field (H04S2420/13 takes precedence)
- H04S 2420/01: Enhancing the perception of the sound image or of the spatial distribution using head related transfer functions [HRTF's] or equivalents thereof, e.g. interaural time difference [ITD] or interaural level difference [ILD]
- H04S: STEREOPHONIC SYSTEMS
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)
- H04M: TELEPHONIC COMMUNICATION (circuits for controlling other apparatus via a telephone cable and not involving telephone switching apparatus G08)

## Abstract

A smartphone displays an emoji that when activated plays sound that externally localizes in binaural sound to the listener. The emoji includes an indication that shows a location where the sound will externally localize as the binaural sound away from a head of the listener when the listener activates the emoji.

## Claims

### Claim at position 1

-20. (canceled)

### Claim 21

A method executed by a wearable electronic device (WED) that enables a listener to know in advance of activating an emoji where binaural sound of an emoji will externally localize to the listener, the method comprising:
displaying, with a display of the WED, the emoji that when activated plays the binaural sound to the listener and that has a body with an indication showing a location where the binaural sound will externally localize away from a head of the listener when the listener activates the emoji.

### Claim 22 (depends on 21)

The method of claim 21 further comprising:
playing, by the WED and through headphones or earbuds when the listener activates the emoji, the binaural sound that externally localizes away from the head of the listener at an augmented reality (AR) or virtual reality (VR) image of the emoji.

### Claim 23 (depends on 21)

The method of claim 21 further comprising:
receiving, at the WED and from a user during an electronic communication between the user and the listener, the emoji and sound being in one of stereo sound or mono sound; and
expediting playing of the sound to the listener by processing, with a digital signal processor (DSP) in the WED, the sound with head-related transfer functions (HRTFs) before the listener activates the emoji to play the sound, wherein processing the sound with the DSP changes the sound from the one of the stereo sound or the mono sound to the binaural sound.

### Claim 24 (depends on 21)

The method of claim 21, wherein the emoji includes a head of an animated character or an animated person, and the method further comprising:
rotating the head of the emoji to provide the indication such that the head of the emoji rotates to face a direction where the binaural sound will externally localize to the listener when the listener activates the emoji.

### Claim 25 (depends on 21)

The method of claim 21 further comprising:
displaying, with the display of the WED, instructions to the listener to wear headphones or earphones while listening to the binaural sound, such instructions being displaying as headphones that flash on and off.

### Claim 26 (depends on 21)

The method of claim 21, wherein the indication includes an arrow pointing to the location where the binaural sound will externally localize away from the head of the listener when the listener activates the emoji.

### Claim 27 (depends on 21)

The method of claim 21, wherein the indication is part of a body of the emoji and visually shows the listener a direction to the location where the binaural sound will externally localize to the listener.

### Claim 28

A non-transitory computer-readable storage medium that stores instructions a wearable electronic device (WED) executes, the method comprising:
assisting a listener in knowing where binaural sound from an emoji will externally localize to the listener when the listener activates the emoji by displaying, with a display of the WED, the emoji with an indication of a sound localization point (SLP) where the binaural sound from the emoji will externally localize to the listener when the listener activates the emoji to hear the binaural sound.

### Claim 29 (depends on 28)

The non-transitory computer-readable storage medium of claim 28, wherein the indication includes text of “3D”.

### Claim 30 (depends on 28)

The non-transitory computer-readable storage medium of claim 28 further comprising:
displaying the head of the emoji with eyes that look in a direction of the SLP such that the eyes provide the indication where the binaural sound from the emoji will externally localize to the listener when the listener activates the emoji to hear the binaural sound, wherein the emoji includes two-dimensional (2D) and three-dimensional (3D) animojis.

### Claim 31 (depends on 28)

The non-transitory computer-readable storage medium of claim 28 further comprising:
displaying the emoji with a head that is rotated to look in a direction of the SLP such that the head rotated toward the direction provides the indication where the binaural sound from the emoji will externally localize to the listener when the listener activates the emoji to hear the binaural sound.

### Claim 32 (depends on 28)

The non-transitory computer-readable storage medium of claim 28 further comprising:
displaying a head of the emoji wearing headphones that change brightness to instruct the listener to wear headphones before activating the emoji to listen to the binaural sound.

### Claim 33 (depends on 28)

The non-transitory computer-readable storage medium of claim 28, wherein the indication visually shows the listener that the binaural sound from the emoji will externally localize to the SLP that is located in front of and on a right side of a head of the listener.

### Claim 34 (depends on 28)

The non-transitory computer-readable storage medium of claim 28, wherein the indication visually shows the listener that the binaural sound from the emoji will externally localize to the SLP that is located in front of and on a left side of a head of the listener.

### Claim 35

A method executed by a wearable electronic device (WED), the method comprising:
enabling a listener to know in advance of activating an emoji that sound of the emoji will externally localize as binaural sound as opposed to stereo sound or mono sound by displaying, with a display of the WED, the emoji as a person or a character that includes an indication visually informing the listener that the sound of the emoji will externally localize as the binaural sound as opposed to the stereo sound or the mono sound when the listener activates the emoji.

### Claim 36 (depends on 35)

The method of claim 35 further comprising:
enabling the listener to know in advance of activating the emoji a location where the sound of the emoji will externally localize as the binaural sound by rotating a head of the person or the character to point in a direction of the location where the sound of the emoji will externally localize as the binaural sound when the listener activates the emoji.

### Claim 37 (depends on 35)

The method of claim 35, wherein the indication includes headphones that flash on and off on a head of the person or the character such that flashing of the headphones instructs the listener to wear headphones before activating the emoji and listening to the binaural sound.

### Claim 38 (depends on 35)

The method of claim 35, wherein the indication is attached to or forms part of a head of the person or the character as opposed to being separate from the head of the person or the character.

### Claim 39 (depends on 35)

The method of claim 35 further comprising:
receiving, at a wireless receiver of the WED and over a wireless network, the sound of the emoji as the stereo sound or the mono sound; and
expediting playing of the sound to the listener by processing, with a digital signal processor in the WED, the sound with head-related transfer functions (HRTFs) after receiving the sound at the wireless receiver but before the listener activates the emoji so the sound is not required to be processed with the HRTFs at a point in time when the listener activates the emoji to hear the sound.

### Claim 40 (depends on 35)

The method of claim 35, wherein the emoji is a three-dimensional (3D) image that talks to the listener, and the sound externally localizes as the binaural sound in empty space at the 3D image one meter away from a head of the listener at azimuth coordinates of 15°≤θ≤60°.