# US 2023/0410979 A1 · Location-based multi-user augmented reality for wellness

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0410979 A1
- Document ID: US20230410979A1
- Status: Published application
- Kind: A1
- Application number: 17/845,979
- Filed: 2022-06-21
- Published: 2023-12-21
- Earliest claimed: 2022-06-21
- Applicants: TRIPP, Inc.
- Inventors: Nanea Reeves; Jason Lee Asbahr; Felipe Lara; Wilson O'neal Westbrook-Fergeson; Zachary Clark Krausnick; Matthew Francis Bracks; Adrian Mark Ludley; Daniel Abram Kharlas
- Web page: https://patentgrep.com/patent/US20230410979A1

## CPC

- G16H 20/70: relating to mental therapies, e.g. psychological therapy or autogenous training
- G16H 40/67: for remote operation
- A61B 5/0022: {Monitoring a patient using a global network, e.g. telephone networks, internet}
- A61B 5/0205: Simultaneously evaluating both cardiovascular conditions and different types of body conditions, e.g. heart and respiratory condition
- A61B 5/02055: {Simultaneously evaluating both cardiovascular condition and temperature}
- A61B 5/1112: {Global tracking of patients, e.g. by using GPS}
- A61B 5/1118: {Determining activity level}
- A61B 5/165: {Evaluating the state of mind, e.g. depression, anxiety}
- A61B 5/744: {Displaying an avatar, e.g. an animated cartoon character}
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06F 3/015: {Input arrangements based on nervous system activity detection, e.g. brain waves [EEG] detection, electromyograms [EMG] detection, electrodermal response detection}
- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- G16H 50/20: for computer-aided diagnosis, e.g. based on medical expert systems
- G16H 50/30: for calculating health indices; for individual health risk assessment
- A61B 5/021: Measuring pressure in heart or blood vessels
- A61B 5/024: Measuring pulse rate or heart rate
- A61B 5/0816: {Measuring devices for examining respiratory frequency (measuring frequency of electric signals G01R23/00)}
- A61B 5/7267: {involving training the classification device}
- A61B 5/7445: {Display arrangements, e.g. multiple display units}
- A61B 2562/0219: Inertial sensors, e.g. accelerometers, gyroscopes, tilt switches
- G06F 2203/011: Emotion or mood input determined on the basis of sensed human body parameters such as pulse, heart rate or beat, temperature of skin, facial expressions, iris, voice pitch, brain activity patterns
- G06T 2210/41: Medical
- G16H 10/20: for electronic clinical trials or questionnaires
- G16H 20/30: relating to physical therapies or activities, e.g. physiotherapy, acupressure or exercising
- G16H 40/63: for local operation
- G16H 50/70: for mining of medical data, e.g. analysing previous cases of other patients
- G16H: HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

An augmented wellness environment is generated at a media processing device, where the augmented wellness environment includes a virtual object. The content of the augmented wellness environment is determined by the activities (e.g., participation in wellness activities) of the user and one or more additional users (e.g., users at a similar location to the user). The augmented wellness environment may be modified based on interactions between users, and the augmented wellness environment may also be modified based on user activity data, such as biometric data (e.g., heart rate, breathing rate, etc.) of one or more users experiencing the augmented wellness environment. Using the user activity data, the system may determine a user's present mental state. The system can modify the augmented wellness environment to alter the user's present mental state to a target mental state.

## Claims

### Claim 1

A non-transitory computer-readable medium comprising instructions for generating an interactive wellness experience, the instructions, when executed by a computing system, causing the computing system to perform operations including:
receiving location data for a user;
identifying, using the location data, at least one additional user;
retrieving activity data corresponding to the user and the at least one additional user;
generating, based on the activity data, augmented wellness environment data for displaying an augmented wellness environment at a client device associated with the user, the augmented wellness environment including a virtual rendered object; and
providing the augmented wellness environment data to the client device.

### Claim 2 (depends on 1)

The non-transitory computer readable medium of claim 1, wherein the operations further include:
determining respective mood scores of the user and the at least one additional user based on biometric data of the user and the at least one additional user;
generating updated augmented wellness environment data based on the mood scores; and
providing the updated augmented wellness environment data to the client device.

### Claim 3 (depends on 2)

The non-transitory computer readable medium of claim 2, wherein the augmented wellness environment comprises output of a first audio signal using a speaker of the client device, and generating the updated augmented wellness environment data includes determining a second audio signal using the determined mood scores, the second audio signal being output by the speaker of the client device.

### Claim 4 (depends on 2)

The non-transitory computer readable medium of claim 2, wherein the augmented wellness environment comprises display of the virtual object in a first color, and generating the updated augmented wellness environment data comprises:
determining a second color based on the determined mood scores; and
including, in the updated augmented wellness environment data, an instruction to display the virtual object in the second color.

### Claim 5 (depends on 1)

The non-transitory computer readable medium of claim 1, wherein the operations further include:
accessing, responsive to detecting a user has completed a wellness experience, interactions between the user and the at least one additional user; and
modifying the augmented wellness environment based on the interactions.

### Claim 6 (depends on 5)

The non-transitory computer readable medium of claim 5, wherein the interactions between the user and the at least one additional user comprises a joint wellness experience.

### Claim 7 (depends on 6)

The non-transitory computer readable medium of claim 6, wherein the operations further include:
determining, during the joint wellness experience, that a number of participants in the joint wellness experience has changed, wherein the number of participants of the joint wellness experience changes as users begin or end respective wellness experiences within a predetermined distance of the participants of the joint wellness experience.

### Claim 8 (depends on 7)

The non-transitory computer readable medium of claim 7, wherein generating the updated augmented wellness environment data comprises:
selecting, responsive to determining a number of participants of the joint wellness experience has increased, an additional virtual object; or
selecting, responsive to determining the number of participants of the joint wellness experience has decreased, a presently displayed virtual object to be removed from display.

### Claim 9 (depends on 6)

The non-transitory computer readable medium of claim 6, wherein the updated augmented wellness environment data are generated based on at least one of:
a location at which the joint wellness experience is performed, the location tracked by a global positioning system (GPS) sensor of the client device, the client device communicatively coupled to the media processing device,
a duration of time during which the joint wellness experience is performed,
a time of day at which the joint wellness experience begins, or
biometric data of participants of the joint wellness experience, the biometric data monitored by one or more sensors coupled to respective media processing devices of the participants.

### Claim 10 (depends on 9)

The non-transitory computer readable medium of claim 9, wherein the biometric data includes one or more of a heart rate or breathing rate.

### Claim 11 (depends on 1)

The non-transitory computer readable medium of claim 1, wherein the virtual object is an avatar of the user, to the operations further comprising:
determining a number of wellness experiences that the user has completed; and
modifying the avatar based on the determined number of wellness experiences.

### Claim 12 (depends on 1)

The non-transitory computer readable medium of claim 1, wherein the virtual object is an augmented reality object.

### Claim 13 (depends on 1)

The non-transitory computer readable medium of claim 1, wherein the operations further include generating, for display at the client device, a dynamic map including icons corresponding to other users within a predetermined distance of the user, the icons indicating whether the other users are participating in a wellness experience.

### Claim 14

A system for generating an interactive wellness experience, the system comprising:
an group coordination engine configured to:
receive location data for a user;
identify, using the location data, at least one additional user; and
retrieve activity data corresponding to the user and the at least one additional user;
an experience creation engine communicatively coupled to the application server, the experience creation engine configured to:
generate, based on the activity data, augmented wellness environment data for displaying an augmented wellness environment at a client device associated with the user, the augmented wellness environment including a virtual rendered object; and
provide the augmented wellness environment data to the client device.

### Claim 15 (depends on 14)

The system of claim 14, wherein the experience creation engine is further configured to:
determine respective mood scores of the user and the at least one additional user based on biometric data of the user and the at least one additional user;
generate updated augmented wellness environment data based on the mood scores; and
provide the updated augmented wellness environment data to the client device.

### Claim 16 (depends on 15)

The system of claim 15, wherein the experience creation engine is configured to:
generate the augmented wellness environment by:
outputting a first audio signal using a speaker of the client device; and
generate the updated augmented wellness environment data by:
determining a second audio signal using the determined mood scores, the second audio signal being output by the speaker of the client device.

### Claim 17 (depends on 15)

The system of claim 15, wherein the experience creation engine is configured to:
generate the augmented wellness environment by:
generating for display the virtual object in a first color; and
generate the updated augmented wellness environment data by:
determining a second color based on the determined mood scores; and
including, in the updated augmented wellness environment data, an instruction to display the virtual object in the second color.

### Claim 18

A method for generating an interactive wellness experience, the method comprising:
receiving location data for a user;
identifying, using the location data, at least one additional user;
retrieving activity data corresponding to the user and the at least one additional user;
generating, based on the activity data, augmented wellness environment data for displaying an augmented wellness environment at a client device associated with the user, the augmented wellness environment including a virtual rendered object; and
providing the augmented wellness environment data to the client device.

### Claim 19 (depends on 18)

The method of claim 18, further comprising:
determining respective mood scores of the user and the at least one additional user based on biometric data of the user and the at least one additional user;
generating updated augmented wellness environment data based on the mood scores; and
providing the updated augmented wellness environment data to the client device.

### Claim 20 (depends on 19)

The method of claim 19, wherein the augmented wellness environment comprises output of a first audio signal using a speaker of the client device, and generating the updated augmented wellness environment data includes determining a second audio signal using the determined mood scores, the second audio signal being output by the speaker of the client device.
