# US 2021/0341292 A1 · Radio Enhanced Augmented Reality And Virtual Reality With Truly Wireless Earbuds

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0341292 A1
- Document ID: US20210341292A1
- Status: Published application
- Kind: A1
- Application number: 17/375,587
- Filed: 2021-07-14
- Published: 2021-11-04
- Earliest claimed: 2019-04-17
- Assignees: Google Inc.
- Applicants: Google LLC
- Inventors: Jiang Zhu; Chi Kin Benjamin Leung
- Web page: https://patentgrep.com/patent/US20210341292A1

## CPC

- G01C 21/206: {specially adapted for indoor navigation}
- H04W 4/024: Guidance services
- G01S 5/0268: {by deriving positions from different combinations of signals or of estimated positions in a single positioning system}
- G01S 5/0273: {using multipath or indirect path propagation signals in position determination}
- G01S 5/0294: {Trajectory determination or predictive filtering, e.g. target tracking or Kalman filtering}
- H04B 17/318: Received signal strength
- H04W 4/029: Location-based management or tracking services
- H04W 4/023: {using mutual or relative location information between multiple location based services [LBS] targets or of distance thresholds}
- H04W 4/026: {using orientation information, e.g. compass}
- H04W 4/33: for indoor environments, e.g. buildings
- G01C: MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY (measuring liquid level G01F; radio navigation, determining distance or velocity by use of propagation effects, e.g. Doppler effects, propagation time, of radio waves, analogous arrangements using other waves G01S)
- H04W: WIRELESS COMMUNICATION NETWORKS (broadcast communication H04H; communication systems using wireless links for non-selective communication, e.g. wireless extensions H04M1/72)
- G01S: RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- H04B: TRANSMISSION

## Abstract

The technology provides for a pair of earbuds. For instance, a first earbud may include a first antenna, and a second earbud may include a second antenna. The pair of earbuds may further include one or more processors configured to receive, from the first antenna, a first signal from a beacon, and receive, from the second antenna, a second signal from the beacon. Based on the first signal and the second signal, the one or more processors may determine at least one signal strength. The one or more processors may determine a position of the user relative to the beacon based on the at least one signal strength.

## Claims

### Claim 1

A method, comprising:
receiving, by one or more processors from a first antenna located in a first earbud worn by a user, a first signal from a beacon;
receiving, by the one or more processors from a second antenna located in a second earbud worn by the user, a second signal from the beacon;
determining, by the one or more processors based on the received first signal and the second signal, a signal strength of the beacon;
determining, by the one or more processors based on the signal strength of the beacon, at least one of a distance between the user to the beacon or a position of the user relative to the beacon;
receiving, by the one or more processors, motion data from one or more sensors indicating a movement of the user; and
correlating, by the one or more processors, the motion data with the first signal and the second signal, wherein determining the distance between the user to the beacon or the position of the user relative to the beacon is further based on the correlated motion data.

### Claim 2 (depends on 1)

The method of claim 1, wherein the first signal and the second signal are received using a same frequency channel.

### Claim 3 (depends on 1)

The method of claim 1, further comprising:
controlling, by the one or more processors, one or more antenna control circuits to combine the first signal and the second signal, wherein the strength of the beacon is determined based on the combined signal.

### Claim 4 (depends on 1)

The method of claim 1, further comprising:
determining, by the one or more processors, that a quality of the first signal is stronger than a quality of the second signal, wherein the signal strength of the beacon is determined based on the first signal.

### Claim 5 (depends on 1)

The method of claim 1, further comprising:
receiving, by the one or more processors from the first antenna, a third signal from a second beacon;
receiving, by the one or more processors from the second antenna, a fourth signal from the second beacon;
determining, by the one or more processors based on the third signal and the fourth signal, at least one other signal strength; and
determining, by the one or more processors based on the at least one other signal strength, at least one of the distance between the user to the second beacon, the position of the user relative to the beacon, or a facing direction of the user relative to the second beacon.

### Claim 6 (depends on 1)

The method of claim 1, further comprising:
receiving, by the one or more processors, a request for navigation instructions for reaching a destination;
accessing, by the one or more processors, a storage system to obtain a location of the destination relative to the beacon;
generating, by the one or more processors based on the location of the destination relative to the beacon and at least one of the distance between the user to the beacon or the position of the user relative to the beacon, navigation instructions for reaching the destination.

### Claim 7 (depends on 6)

The method of claim 6, wherein the beacon and the destination are in an indoor environment.

### Claim 8 (depends on 6)

The method of claim 6, further comprising:
receiving, by the one or more processors from the first antenna, a third signal from the beacon;
receiving, by the one or more processors from the second antenna, a fourth signal from the beacon;
determining, by the one or more processors based on the third signal and the fourth signal, at least one new signal strength;
determining, by the one or more processors based on the at least one new signal strength, a new distance between the user to the beacon; and
generating, by the one or more processors based on the new distance between the user to the beacon, updated navigation instructions for reaching the destination.

### Claim 9 (depends on 1)

The method of claim 1, further comprising:
receiving, by the one or more processors from the first antenna, a third signal from the beacon;
receiving, by the one or more processors from the second antenna, a fourth signal from the beacon;
comparing, by the one or more processors, the third signal and the fourth signal;
determining, by the one or more processors based on the comparison, a new distance between the user to the beacon or a new position of the user relative to the beacon; and
generating, by the one or more processors based on the new the new distance between the user to the beacon or the new position of the user relative to the beacon, updated navigation instructions for reaching the destination.

### Claim 10 (depends on 1)

The method of claim 1, further comprising:
receiving, by the one or more processors, a request for additional information about items in an indoor environment;
accessing, by the one or more processors, a storage system to obtain locations of a plurality of items relative to the beacon in the indoor environment;
determining, by the one or more processors based on the position of the user relative to the beacon and the locations of the plurality of items relative to the beacon, a position of the user relative to an item of the plurality of items;
determining, by the one or more processors based on the position of the user relative to the item, that the user is viewing the item;
accessing, by the one or more processors, the storage system to obtain additional information about the item; and
generating, by the one or more processors, an output including the additional information about the item.

### Claim 11 (depends on 10)

The method of claim 10, further comprising:
comparing, by the one or more processors, an arrival time or a signal strength of the received first signal and the received second signal; and
determining, by the one or more processors, based on the comparison of the arrival time or the signal strength of the received first and second signals, a facing direction of the user with respect to the beacon; and
determining, by the one or more processors based on the position of the user relative to the item and the facing direction of the user with respect to the beacon, a facing direction of the user with respect to the item, wherein determining that the user is viewing the item is further based on the facing direction of the user with respect to the item.

### Claim 12 (depends on 10)

The method of claim 10, further comprising:
receiving, by the one or more processors, motion data from one or more sensors indicating a movement of the user, wherein determining that the user is viewing the item is further based on the motion data.

### Claim 13 (depends on 1)

The method of claim 1, further comprising:
receiving, by the one or more processors, a request for enhanced interactive experience;
accessing, by the one or more processors, a storage system to obtain a location of a display relative to the beacon;
determining, by the one or more processors based on the position of the user relative to the beacon and the location of the display relative to the beacon, a position of the user relative to the display;
controlling, by the one or more processors based on the position of the user relative to the display, one or more characteristics of an audio output.

### Claim 14 (depends on 13)

The method of claim 13, further comprising:
comparing, by the one or more processors, an arrival time or a signal strength of the received first signal and the received second signal; and
determining, by the one or more processors, based on the comparison of the arrival time or the signal strength of the received first and second signals, a facing direction of the user with respect to the beacon; and
determining, by the one or more processors based on the position of the user relative to the display and the facing direction of the user with respect to the beacon, a facing direction of the user with respect to the display, wherein controlling the one or more characteristics of the audio output is further based on the facing direction of the user with respect to the display.

### Claim 15 (depends on 13)

The method of claim 13, wherein controlling the one or more characteristics of the audio output is further based on the motion data.

### Claim 16

A system, comprising:
one or more processors configured to:
receive, from a first antenna located in a first earbud worn by a user, a first signal from a beacon;
receive, from a second antenna located in a second earbud worn by the user, a second signal from the beacon;
determine, based on the received first signal and the second signal, a signal strength of the beacon;
determine, based on the signal strength of the beacon, at least one of a distance between the user to the beacon or a position of the user relative to the beacon;
receive motion data from one or more sensors indicating a movement of the user; and
correlate the motion data with the first signal and the second signal, wherein determining the distance between the user to the beacon or the position of the user relative to the beacon is further based on the correlated motion data.

### Claim 17 (depends on 16)

The system of claim 16, further comprising:
one or more output devices configured to generate outputs with one or more characteristics based on the facing direction of the user with respect to the beacon.

### Claim 18

A pair of earbuds, comprising:
a first earbud including a first antenna;
a second earbud including a second antenna; and
one or more processors configured to:
receive, from the first antenna, a first signal from a beacon;
receive, from the second antenna, a second signal from the beacon;
determine, based on the received first signal and the second signal, a signal strength of the beacon;
determine, based on the signal strength of the beacon, at least one of a distance between the user to the beacon or a position of the user relative to the beacon;
receive motion data from one or more sensors indicating a movement of the user; and
correlate the motion data with the first signal and the second signal, wherein determining the distance between the user to the beacon or the position of the user relative to the beacon is further based on the correlated motion data.
