# US 12,009,089 B2 · System for extended reality visual contributions > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,009,089 B2 - Document ID: US12009089B2 - Status: Granted - Kind: B2 - Application number: 18/062,069 - Filed: 2022-12-06 - Published: 2023-03-30 - Granted: 2024-06-11 - Earliest claimed: 2020-06-03 - Assignees: AT&T Intellectual Property I, L.P. - Applicants: AT&T Intellectual Property I, L.P. - Inventors: James Jackson; Eric Zavesky; James Pratt - Web page: https://patentgrep.com/patent/US12009089B2 ## CPC - G16H 20/70: relating to mental therapies, e.g. psychological therapy or autogenous training - A61B 5/165: {Evaluating the state of mind, e.g. depression, anxiety} - A61M 21/00: Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis - A61M 21/02: for inducing sleep or relaxation, e.g. by direct nerve stimulation, hypnosis, analgesia (for massage A61H; electrotherapy A61N, e.g. applying alternating or intermittent electric currents for producing anaesthesia A61N1/36021) - B60T 7/18: operated by wayside apparatus - B60T 7/22: initiated by contact of vehicle, e.g. bumper, with an external object, e.g. another vehicle {, or by means of contactless obstacle detectors mounted on the vehicle} - B60T 17/18: Safety devices; Monitoring - G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)} - G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)} - A61M 21/0094: {Isolation chambers used therewith, i.e. for isolating individuals from external stimuli (other treatment rooms or enclosures A61G10/00)} - A61M 2021/0022: {by the tactile sense, e.g. vibrations} - A61M 2021/0027: {by the hearing sense} - A61M 2021/005: {images, e.g. video} - A61M 2205/3317: Electromagnetic, inductive or dielectric measuring means - A61M 2205/332: Force measuring means - A61M 2205/3368: Temperature - A61M 2205/3375: Acoustical, e.g. ultrasonic, measuring means - A61M 2205/3553: remote, e.g. between patient's home and doctor's office - A61M 2205/3592: using telemetric means, e.g. radio or optical transmission - A61M 2205/505: Touch-screens; Virtual keyboard or keypads; Virtual buttons; Soft keys; Mouse touches - A61M 2205/507: Head Mounted Displays [HMD] - A61M 2205/52: with memories providing a history of measured variating parameters of apparatus or patient - A61M 2205/609: Biometric patient identification means - A61M 2205/80: voice-operated command - A61M 2205/8206: battery-operated - A61M 2205/8237: Charging means - A61M 2205/8262: connectable to external power source, e.g. connecting to automobile battery through the cigarette lighter - A61M 2209/088: on the body - A61M 2230/06: Heartbeat rate only - A61M 2230/30: Blood pressure (A61M2230/04 takes precedence) - A61M 2230/42: Rate - A61M 2230/62: Posture - A61M 2230/63: Motion, e.g. physical activity - A61M 2230/65: Impedance, e.g. conductivity, capacity - B60T 2210/32: Vehicle surroundings - G06F 2203/011: Emotion or mood input determined on the basis of sensed human body parameters such as pulse, heart rate or beat, temperature of skin, facial expressions, iris, voice pitch, brain activity patterns - G09B 9/00: Simulators for teaching or training purposes (for the use of weapons F41; computing aspects G06; {protocols for games, networked simulations or virtual reality H04L67/131}) - G16H: HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA - A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D) - A61M: DEVICES FOR INTRODUCING MEDIA INTO, OR ONTO, THE BODY (introducing media into or onto the bodies of animals A61D7/00; means for inserting tampons A61F13/26; devices for administering food or medicines orally A61J; containers for collecting, storing or administering blood or medical fluids A61J1/05); DEVICES FOR TRANSDUCING BODY MEDIA OR FOR TAKING MEDIA FROM THE BODY (surgery A61B; chemical aspects of surgical articles A61L); DEVICES FOR PRODUCING OR ENDING SLEEP OR STUPOR {(Electrotherapy, e.g. producing anaesthesia by the use of alternating or intermittent currents A61N1/36021)} - B60T: VEHICLE BRAKE CONTROL SYSTEMS OR PARTS THEREOF; BRAKE CONTROL SYSTEMS OR PARTS THEREOF, IN GENERAL (electrodynamic brake systems for vehicle, in general B60L; brakes per se, i.e. devices where braking effect occurs, including ultimate brake actuators, F16D); ARRANGEMENT OF BRAKING ELEMENTS ON VEHICLES IN GENERAL; PORTABLE DEVICES FOR PREVENTING UNWANTED MOVEMENT OF VEHICLES; VEHICLE MODIFICATIONS TO FACILITATE COOLING OF BRAKES - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - G09B: EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS (devices for psychotechnics or for testing reaction times A61B5/16; games, sports, amusements A63; projectors, projector screens G03B) ## Abstract Aspects of the subject disclosure may include, for example, receiving information about a task to be completed by a user, receiving information about the user and receiving information about a physical environment of the user. The subject disclosure may further include creating one or more immersion objects based on the information about the task, the information about the user and the information about the physical environment, creating an immersive environment including the one or more immersive objects and at least a portion of the physical environment of the user, and communicating to an extended reality (XR) device of the user information about the immersive environment to create an immersive experience for completion of the task by the user. Other embodiments are disclosed. ## Claims ### Claim 1 A device, comprising: a processing system including a processor; and a memory that stores executable instructions that, when executed by the processing system, facilitate performance of operations, the operations comprising: receiving information about a user; creating one or more immersion objects, wherein the creating is based on the information about the user; creating an immersive environment including the one or more immersion objects; communicating, to an extended reality (XR) device of the user, information about the immersive environment to create an immersive experience for the user; receiving user mood information about a mood of the user; modifying the immersive environment, forming a modified immersive environment, wherein the modifying is based on the mood of the user; and communicating, to the XR device of the user, information about the modified immersive environment. ### Claim 2 (depends on 1) The device of claim 1, wherein the receiving user mood information comprises: receiving, from one or more sensors associated with the user, biometric information of the user; and determining from the biometric information if the one or more immersion objects in the immersive environment produces a positive effect on the mood of the user. ### Claim 3 (depends on 2) The device of claim 2, wherein the modifying the immersive environment comprises: modifying at least one immersion object of the immersive environment to produce a positive effect on the mood of the user; and receiving updates of information about activity of the user during the modifying. ### Claim 4 (depends on 1) The device of claim 1, further comprising: receiving information about a fear of a particular object by the user; and creating a virtual object matching the particular object for insertion in the immersive environment with the user. ### Claim 5 (depends on 4) The device of claim 4, wherein the operations further comprise: progressively exposing the user to the virtual object matching the particular object in the immersive environment. ### Claim 6 (depends on 5) The device of claim 5, wherein the operations further comprise: exposing the user to an image of the virtual object; receiving, from one or more sensors associated with the user, biometric information of the user; based on the biometric information, determining a current mood of the user; and increasing exposure of the user to the image of the virtual object based on the current mood of the user. ### Claim 7 (depends on 6) The device of claim 6, wherein the receiving user mood information comprises: receiving information about a current anxiety level and mental state of the user. ### Claim 8 (depends on 7) The device of claim 7, wherein the operations further comprise: receiving update information about activities of the user; receiving update biometric information about the user; and modifying the exposure of the user to the image of the virtual object based on the update information about activities of the user and the update biometric information about the user. ### Claim 9 (depends on 1) The device of claim 1, wherein the operations further comprise: receiving, from one or more sensors associated with the user, information about a physical environment of the user and biometric information of the user; continuously scanning and mapping the physical environment of the user; and identifying a location of the physical environment, items in the physical environment and activities in the physical environment. ### Claim 10 (depends on 9) The device of claim 9, wherein the operations further comprise: determining items in the immersive environment that affect the mood of the user; and determining how virtual content in the immersive environment can affect the mood of the user. ### Claim 11 A non-transitory, machine-readable medium, comprising executable instructions that, when executed by a processing system including a processor, facilitate performance of operations, the operations comprising: receiving information about a user; receiving information about a physical environment of the user, including receiving information about objects in the physical environment and associated with the user; creating one or more immersion objects, wherein the creating is based on the information about the physical environment; creating, on an extended reality (XR) device of the user, an immersive environment including the one or more immersion objects and at least a portion of the physical environment of the user including the objects in the physical environment; adjusting an image of the immersive environment to adjust a focus of attention of the user on a particular immersion object of the one or more immersion objects; receiving user mood information about a mood of the user; modifying the immersive environment, forming a modified immersive environment, wherein the modifying is based on the mood of the user; and communicating, to the XR device of the user, information about the modified immersive environment. ### Claim 12 (depends on 11) The non-transitory, machine-readable medium of claim 11, wherein the adjusting the image of the immersive environment comprises: blocking or blurring, or a combination of these, objects in the image surrounding the particular immersion object. ### Claim 13 (depends on 11) The non-transitory, machine-readable medium of claim 11, wherein the adjusting the image of the immersive environment comprises: rendering the particular immersion object in the image at a first resolution; and rendering objects in the image surrounding the particular immersion object at a second resolution, wherein the second resolution is at a lower resolution to adjust the focus of the attention of the user on the particular immersion object; and communicating data about first resolution and the second resolution to the XR device of the user; receiving, from one or more sensors associated with the user, biometric information of the user; and determining from the biometric information if the particular immersion object in the immersive environment produces an effect on the mood of the user. ### Claim 14 (depends on 11) The non-transitory, machine-readable medium of claim 11, wherein the operations further comprise: receiving information about a current anxiety level and mental state of the user; and wherein the modifying is based on the current anxiety level and mental state of the user, forming a modified immersive environment. ### Claim 15 (depends on 11) The non-transitory, machine-readable medium of claim 11, wherein the operations further comprise: receiving biometric information about a current anxiety level and mental state of the user; modifying the immersive environment to modify the current anxiety level or mental state of the user, or both; receiving update biometric information about the user; and adjusting the image of the immersive environment to adjust the focus of attention of the user on the particular immersion object of the one or more immersion objects. ### Claim 16 A method, comprising: receiving, by a processing system including a processor, information about a user; receiving, by the processing system, information about a physical environment of the user; creating, by the processing system, one or more immersion objects, wherein the creating is based on the information about the user and the information about the physical environment; creating, by the processing system, an immersive environment including the one or more immersion objects and at least a portion of the physical environment of the user; communicating, by the processing system, to an extended reality (XR) device of the user, information about the immersive environment to create an immersive experience for the user; receiving, by the processing system, user mood information about a mood of the user; modifying, by the processing system, the immersive environment to create a modified immersive environment, wherein the modifying is based on the mood of the user; and communicating, by the processing system, to the XR device of the user, information about the modified immersive environment. ### Claim 17 (depends on 16) The method of claim 16, further comprising: receiving, by the processing system, from one or more sensors associated with the user, biometric information of the user; and identifying, by the processing system, a positive effect on the mood of the user produced by the one or more immersion objects in the immersive environment, wherein the identifying the positive effect on the mood of the user is based on the biometric information. ### Claim 18 (depends on 17) The method of claim 17, further comprising: continuously receiving, by the processing system, updated user mood information about the mood of the user; identifying, by the processing system, a current mood of the user; determining, by the processing system, a modification of the one or more immersion objects in the immersive environment to modify the mood of the user; and modifying, by the processing system, the one or more immersion objects in the immersive environment according to the modification; and identifying, by the processing system, a subsequent mood of the user. ### Claim 19 (depends on 18) The method of claim 18, further comprising: retrieving, by the processing system, past mood information of the user, wherein the past mood information is retrieved from memory; and initiating, by the processing system, a process to learn preferences of the user, wherein the process to learn the preferences of the user is based on the past mood information of the user. ### Claim 20 (depends on 18) The method of claim 18, further comprising: retrieving, by the processing system, mood information about one or more users having a demographic similarity with the user, wherein the mood information about one or more users is retrieved from memory; and initiating, by the processing system, a process to learn preferences of the user, wherein the process to learn the preferences of the user is based on the mood information about one or more users.