# US 12,007,561 B2 · Methods and devices related to extended reality > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,007,561 B2 - Document ID: US12007561B2 - Status: Granted - Kind: B2 - Application number: 17/277,869 - Filed: 2020-12-22 - Published: 2022-12-22 - Granted: 2024-06-11 - Earliest claimed: 2020-12-22 - Assignees: Telefonaktiebolaget LM Ericsson (publ) - Applicants: Telefonaktiebolaget LM Ericsson (publ) - Inventors: Gregoire Phillips; Paul McLachlan; Héctor Caltenco - Web page: https://patentgrep.com/patent/US12007561B2 ## CPC - G02B 27/017: {Head mounted} - G02B 27/0172: {characterised by optical features} - A63F 13/212: using sensors worn by the player, e.g. for measuring heart beat or leg activity - A63F 13/28: responding to control signals received from the game device for affecting ambient conditions, e.g. for vibrating players' seats, activating scent dispensers or affecting temperature or light - A63F 13/79: involving player-related data, e.g. identities, accounts, preferences or play histories - G02B 27/0093: {with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking} - G06F 1/163: {Wearable computers, e.g. on a belt} - G06F 1/1684: {Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675} - G06F 1/1694: {the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer} - G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)} - G06F 3/015: {Input arrangements based on nervous system activity detection, e.g. brain waves [EEG] detection, electromyograms [EMG] detection, electrodermal response detection} - G06F 3/016: {Input arrangements with force or tactile feedback as computer generated output to the user} - G06F 3/0346: with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors - G06F 3/04815: Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object - G06F 3/165: {Management of the audio stream, e.g. setting of volume, audio stream path} - G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)} - G06F 9/451: Execution arrangements for user interfaces - G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS - A63F: CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL ## Abstract A method performed by an XR rending device (124) having an NCOD (199) for generating, for a first user, XR content for an XR environment with which the first user is interacting. The method includes obtaining first user preference information for the first user, the first user preference information comprising sensory permission information indicating, expressly or implicitly, one or more sensory stimulations to which the first user agrees to be exposed. The method also includes obtaining XR scene configuration information for use in generating XR content for the first user. The method also includes generating XR content for the first user based on the sensory permission information and the XR scene configuration information such that the generated XR content does not comprise XR content for producing any sensory stimulation to which the first user has not agreed to be exposed. The method further includes providing the generated XR content to an XR user device worn by the first user, wherein the XR user device comprises one or more sensory actuators for producing one or more sensory stimulations. ## Claims ### Claim 1 A method performed by an extended reality (XR) rending device having a neuro-muscular connectivity overlay device (NCOD) for generating, for a first user, XR content for an XR environment with which the first user is interacting, the method comprising: obtaining first user preference information for the first user, the first user preference information comprising sensory permission information indicating, expressly or implicitly, i) one or more tactile feedback stimulations to which the first user agrees to be exposed, ii) one or more olfactory stimulations to which the first user agrees to be exposed, and/or iii) one or more taste stimulations to which the first user agrees to be exposed; obtaining XR scene configuration information for use in generating XR content for the first user; generating XR content for the first user based on the sensory permission information and the XR scene configuration information such that the generated XR content does not comprise XR content for producing any sensory stimulation to which the first user has not agreed to be exposed; and providing the generated XR content to an XR user device worn by the first user, wherein the XR user device comprises one or more sensory actuators for producing one or more sensory stimulations, wherein the sensory permission information comprises a data record comprising an actuator identifier identifying a particular feedback actuator. ### Claim 2 (depends on 1) The method of claim 1, wherein the XR scene configuration information indicates that the XR content should or must include data corresponding to a particular tactile feedback stimulation to which the first user has not agreed to be exposed, and generating the XR content for the first user based on the sensory permission information and the XR scene configuration information comprises refraining from including in the generated XR content the data corresponding to the particular tactile feedback stimulation. ### Claim 3 (depends on 2) The method of claim 2, wherein generating the XR content for the first user based on the sensory permission information and the XR scene configuration information further comprises: using the sensory permission information to generate tactile feedback XR content data corresponding to a modified version of the particular tactile feedback stimulation; and including in the generated XR content said generated tactile feedback XR content data. ### Claim 4 (depends on 1) The method of claim 1, further comprising: obtaining XR action information pertaining to a second user with which the first user is interacting within the XR environment, wherein the generation of the XR content is further based on the XR action information pertaining to the second user. ### Claim 5 (depends on 4) The method of claim 4, wherein the XR action information pertaining to the second user indicates that the second user has performed an action intended to cause the XR rendering device to produce XR content for producing a particular tactile feedback stimulation for the first user, and generating the XR content for the first user based on the sensory permission information, the XR scene configuration information, and the XR action information pertaining to the second user comprises refraining from including in the generated XR content the XR content for producing the particular tactile feedback stimulation. ### Claim 6 (depends on 5) The method of claim 5, wherein generating the XR content for the first user based on the sensory permission information, the XR scene configuration information, and the XR action information pertaining to the second user further comprises including in the generated XR content data corresponding to a modified version of the particular tactile feedback stimulation. ### Claim 7 (depends on 1) The method of claim 1, further comprising: obtaining environmental data indicating a tactile feedback stimulation in the first user's physical environment, wherein the generation of the XR content is further based on the environmental data. ### Claim 8 (depends on 1) The method of claim 1, wherein obtaining first user preference information comprises obtaining pre-specified first user preference information. ### Claim 9 (depends on 1) A computer program product comprising a non-transitory computer readable medium storing a computer program comprising instructions which when executed by processing circuitry of an extended reality (XR) rendering device, causes the XR rendering device to perform the method of claim 1. ### Claim 10 (depends on 1) The method of claim 1, wherein the data record further comprises permission information indicating at least a first type of feedback to which the first user agrees to be exposed. ### Claim 11 (depends on 1) The method of claim 1, wherein the data record further comprises: an object identifier identifying a particular object or a particular type of object and permission information indicating at least a first type of tactile feedback to which the first user agrees to be exposed with respect to the particular object or particular object type. ### Claim 12 A method performed by neuro-muscular connectivity overlay device (NCOD) for moderating a first user's sensory experience with respect to an extended reality (XR) environment with which the first user is interacting, the method comprising: obtaining first user preference information for the first user, the first user preference information comprising sensory permission information indicating i) one or more tactile feedback stimulations to which the first user expressly or implicitly agrees to be exposed, ii) one or more olfactory stimulations to which the first user agrees to be exposed, and/or iii) one or more taste stimulations to which the first user agrees to be exposed; obtaining XR content produced by an XR rending device; and modifying the XR content based on the sensory permission information to produce modified XR content that does not comprise XR content for producing any sensory stimulation to which the first user has not agreed to be exposed, wherein the modified XR content is translated by an XR user device into at least one sensory stimulation, wherein the sensory permission information comprises a data record comprising an actuator identifier identifying a particular feedback actuator. ### Claim 13 (depends on 12) The method of claim 12, wherein the XR content includes data corresponding to a particular tactile feedback stimulation, the sensory permission information indicates that the first user has not agreed to be exposed to the particular tactile feedback stimulation, and modifying the XR content based on the sensory permission information comprises modifying the XR content such that the data is not included in the modified XR content. ### Claim 14 (depends on 13) The method of claim 13, wherein the data corresponding to the particular tactile feedback stimulation was generated by the XR rendering device based on one or more actions performed by a second user with which the first user is interacting in the XR environment. ### Claim 15 (depends on 13) The method of claim 13, wherein modifying the XR content based on the sensory permission information further comprises including in the modified XR content data corresponding to a modified version of the particular tactile feedback stimulation. ### Claim 16 (depends on 12) The method of claim 12, further comprising: obtaining environmental data indicating a tactile feedback stimulation in the first user's physical environment, wherein the modification of the XR content is further based on the environmental data. ### Claim 17 (depends on 12) The method of claim 12, wherein obtaining first user preference information comprises obtaining pre-specified first user preference information. ### Claim 18 (depends on 12) A computer program product comprising a non-transitory computer readable medium storing a computer program comprising instructions which when executed by processing circuitry of a neuro-muscular connectivity overlay device, (NCOD) causes the NCOD to perform the method of claim 12. ### Claim 19 An extended reality (XR) rendering device for generating, for a first user, XR content for an XR environment with which the first user is interacting, the XR rendering device comprising a neuro-muscular connectivity overlay device (NCOD) comprising: processing circuitry; and a memory, the memory containing instructions executable by the processing circuitry, whereby the XR rendering device is configured to: obtain first user preference information for the first user, the first user preference information comprising sensory permission information indicating, expressly or implicitly, i) one or more tactile feedback stimulations to which the first user agrees to be exposed, ii) one or more olfactory stimulations to which the first user agrees to be exposed, and/or iii) one or more taste stimulations to which the first user agrees to be exposed; obtain XR scene configuration information for use in generating XR content for the first user; generate XR content for the first user based on the sensory permission information and the XR scene configuration information such that the generated XR content does not comprise XR content for producing any sensory stimulation to which the first user has not agreed to be exposed; and provide the generated XR content to an XR user device worn by the first user, wherein the XR user device comprises one or more sensory actuators for producing one or more sensory stimulations, wherein the sensory permission information comprises a data record comprising an actuator identifier identifying a particular feedback actuator. ### Claim 20 A neuro-muscular connectivity overlay device (NCOD) comprising: processing circuitry; and a memory, the memory containing instructions executable by the processing circuitry, whereby the NCOD is configured to: obtain first user preference information for the first user, the first user preference information comprising sensory permission information indicating i) one or more tactile feedback stimulations to which the first user expressly or implicitly agrees to be exposed, ii) one or more olfactory stimulations to which the first user agrees to be exposed, and/or iii) one or more taste stimulations to which the first user agrees to be exposed; obtain XR content produced by an XR rending device; and modify the XR content based on the sensory permission information to produce modified XR content that does not comprise XR content for producing any sensory stimulation to which the first user has not agreed to be exposed, wherein the modified XR content is translated by an XR user device into at least one sensory stimulation, wherein the sensory permission information comprises a data record comprising an actuator identifier identifying a particular feedback actuator.