# US 2024/0257434 A1 · Prioritizing rendering by extended reality rendering device responsive to rendering prioritization rules

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0257434 A1
- Document ID: US20240257434A1
- Status: Published application
- Kind: A1
- Application number: 18/562,016
- Filed: 2021-05-19
- Published: 2024-08-01
- Earliest claimed: 2021-05-19
- Assignees: Telefonaktiebolaget LM Ericsson (publ)
- Applicants: Telefonaktiebolaget LM Ericsson (publ)
- Inventors: Peter ÖKVIST; Tommy ARNGREN; Andreas KRISTENSSON
- Web page: https://patentgrep.com/patent/US20240257434A1

## CPC

- A63F 13/52: involving aspects of the displayed game scene
- A63F 13/79: involving player-related data, e.g. identities, accounts, preferences or play histories
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06Q 10/10: Office automation; Time management
- G06Q 10/40: Business processes related to social networking or social networking services
- G06Q 30/0641: {utilising user interfaces specially adapted for shopping}
- G06T 13/40: of characters, e.g. humans, animals or virtual beings
- G06T 15/005: {General purpose rendering architectures}
- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- H04N 7/157: {defining a virtual conference space and using avatars or agents (computer conference optimisation or adaptation H04L12/1827)}
- G06F 2203/011: Emotion or mood input determined on the basis of sensed human body parameters such as pulse, heart rate or beat, temperature of skin, facial expressions, iris, voice pitch, brain activity patterns
- G06F 2203/0382: Plural input, i.e. interface arrangements in which a plurality of input device of the same type are in communication with a PC
- A63F: CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

An XR rendering device renders an immersive XR environment on a display device for viewing by a participant among a group of participants who have associated avatars representing the participants which are rendered in the immersive XR environment. The XR rendering device obtains rendering prioritization rules which indicate conditions for prioritizing rendering of avatars and/or virtual objects associated with the avatars. The XR rendering device prioritizes rendering of particular ones of the avatars and/or particular ones of the virtual objects which have satisfied conditions indicated by the rendering prioritization rules, when rendering in the immersive XR environment the avatars representing the group of the participants and/or the virtual objects associated with the avatars.

## Claims

### Claim 1

An extended reality, XR, rendering device comprising:
at least one processor; and
at least one memory storing instructions executable by the at least one processor to perform operations to:
render an immersive XR environment on a display device for viewing by a participant among a group of participants who have associated avatars representing the participants which are rendered in the immersive XR environment;
obtain rendering prioritization rules which indicate conditions for prioritizing rendering of avatars and/or virtual objects associated with the avatars; and
when rendering in the immersive XR environment the avatars representing the group of the participants and/or the virtual objects associated with the avatars,
prioritize rendering of particular ones of the avatars and/or particular ones of the virtual objects which have satisfied conditions indicated by the rendering prioritization rules.

### Claim 2 (depends on 1)

The XR rendering device of claim 1, wherein the conditions indicated by the rendering prioritization rules are related to at least one of:
personal relationships defined among the group of participants in the immersive XR environment;
contexts of the immersive XR environment; and
participant roles in the immersive XR environment.

### Claim 3 (depends on 2)

The XR rendering device of claim 2, wherein the personal relationships defined among the participants in the immersive XR environment are related to at least one of:
observed historical interaction between first and second participants among the group of participants in the immersive XR environment;
the first participant having contact information stored in a contact information repository for the second participant;
the first participant having been in a previous session for an immersive XR environment with the second participant; and
the first participant having interacted with an avatar representing the second participant during a previous session for an immersive XR environment.

### Claim 4 (depends on 2)

The XR rendering device of claim 2, wherein the contexts of the immersive XR environment related to at least one of:
type of immersive XR environment; number of participants in the immersive XR environment;
number of participants who are actively interacting with the immersive XR environment;
identities of participants who are actively interacting with the immersive XR environment; and
identities of participants who are interacting with other participants within the immersive XR environment.

### Claim 5 (depends on 2)

The XR rendering device of claim 2, wherein the participant roles in the immersive XR environment relate to at least one of:
one of the participants having a presenter status;
one of the participants having a meeting organizer status; and
one of the participants having a non-presenting participant status.

### Claim 6 (depends on 1)

The XR rendering device of claim 1, wherein the conditions indicated by the rendering prioritization rules are related to at least one of:
an avatar of a first participant among the group of participants is animated as actively talking; voice loudness of the first participant;
the first participant streaming content to other participants among the group of participants;
the first participant having an avatar within a threshold angular offset of current field of view, FOV, of the participant viewing the immersive XR environment;
the FOV of the participant viewing the immersive XR environment rotating towards the avatar of the first participant;
the participant viewing the immersive XR environment having eye-contact with the avatar of the first participant; and
the participant viewing the immersive XR environment inputting a gesture towards the avatar of the first participant.

### Claim 7 (depends on 1)

The XR rendering device of claim 1, wherein the conditions indicated by the rendering prioritization rules are related to at least one of:
the avatar of a first participant among the group of participants is within a threshold distance of location of the avatar of the participant viewing the immersive XR environment;
the avatar of the first participant is within a threshold distance of emerging from behind a virtual object of the immersive XR environment that is currently preventing viewing by the participant viewing the immersive XR environment; and
the avatar of the first participant is within a threshold time of become viewable by the participant viewing the immersive XR environment based on projected movement by the avatar of the one of the participants or by the participant viewing the immersive XR environment.

### Claim 8 (depends on 1)

The XR rendering device of claim 1, wherein one of the conditions indicated by the rendering prioritization rules is related to a facial emotion status of the avatar of one of the participants.

### Claim 9 (depends on 1)

The XR rendering device of claim 1, wherein one of the conditions indicated by the rendering prioritization rules is related to rendering resource loading of a participant's device relative to a threshold capacity level.

### Claim 10 (depends on 1)

The XR rendering device of claim 1, wherein when rendering in the immersive XR environment the avatars representing the group of the participants and/or the virtual objects associated with the avatars, the operations prioritize rendering one of the virtual objects based on the rendering prioritization rules defining one of the following conditions that is determined to be satisfied:
the virtual object is touched by the avatar of a first participant among the group of participants;
the virtual object is within a threshold distance of the avatar of the first participant, wherein the threshold distance is defined by the rendering prioritization rules;
the virtual object is within a field of view, FOV, of a pose of the avatar in the immersive XR environment;
the virtual object is within a threshold angular offset from the FOV of the pose of the avatar of the first participant, wherein the threshold angular offset is defined by the rendering prioritization rules;
the virtual object is predicted to become within the FOV of the pose of the avatar of the first participant within a threshold time defined by the rendering prioritization rules; and
the virtual object is predicted to become within the threshold distance of the avatar of the first participant within the threshold time defined by the rendering prioritization rules.

### Claim 11

A method by an extended reality, XR, rendering device comprising:
rendering an immersive XR environment on a display device for viewing by a participant among a group of participants who have associated avatars representing the participants which are rendered in the immersive XR environment;
obtaining rendering prioritization rules which indicate conditions for prioritizing rendering of avatars and/or virtual objects associated with the avatars; and
when rendering in the immersive XR environment the avatars representing the group of the participants and/or the virtual objects associated with the avatars,
prioritizing rendering of particular ones of the avatars and/or particular ones of the virtual objects which have satisfied conditions indicated by the rendering prioritization rules.

### Claim 12 (depends on 11)

The method of claim 11, wherein the conditions indicated by the rendering prioritization rules are related to at least one of:
personal relationships defined among the participants in the immersive XR environment;
contexts of the immersive XR environment; and
participant roles in the immersive XR environment.

### Claim 13 (depends on 12)

The method of claim 12, wherein the personal relationships defined among the participants in the immersive XR environment are related to at least one of:
observed historical interaction between first and second participants among the group of participants in the immersive XR environment;
the first participant having contact information stored in a contact information repository for the second participant;
the first participant having been in a previous session for an immersive XR environment with the second participant; and
the first participant having interacted with an avatar representing the second participant during a previous session for an immersive XR environment.

### Claim 14 (depends on 12)

The method of claim 12, wherein the contexts of the immersive XR environment related to at least one of:
type of immersive XR environment;
number of participants in the immersive XR environment;
number of participants who are actively interacting with the immersive XR environment;
identities of participants who are actively interacting with the immersive XR environment; and
identities of participants who are interacting with other participants within the immersive XR environment.

### Claim 15 (depends on 12)

The method of claim 12, wherein the participant roles in the immersive XR environment relate to at least one of:
one of the participants having a presenter status;
one of the participants having a meeting organizer status; and
one of the participants having a non-presenting participant status.

### Claim 16 (depends on 11)

The method of claim 11, wherein the conditions indicated by the rendering prioritization rules are related to at least one of:
an avatar of a first participant among the group of participants is animated as actively talking;
voice loudness of the first participant;
the first participant streaming content to other participants among the group of participants;
the first participant having an avatar within a threshold angular offset of current field of view, FOV, of the participant viewing the immersive XR environment;
the FOV of the participant viewing the immersive XR environment rotating towards the avatar of the first participant;
the participant viewing the immersive XR environment having eye-contact with the avatar of the first participant; and
the participant viewing the immersive XR environment inputting a gesture towards the avatar of the first participant.

### Claim 17 (depends on 11)

The method of claim 11, wherein the conditions indicated by the rendering prioritization rules are related to at least one of:
the avatar of a first participant among the group of participants is within a threshold distance of location of the avatar of the participant viewing the immersive XR environment;
the avatar of the first participant is within a threshold distance of emerging from behind a virtual object of the immersive XR environment that is currently preventing viewing by the participant viewing the immersive XR environment; and
the avatar of the first participant is within a threshold time of become viewable by the participant viewing the immersive XR environment based on projected movement by the avatar of the one of the participants or by the participant viewing the immersive XR environment.

### Claim 18 (depends on 11)

The method of claim 11, wherein one of the conditions indicated by the rendering prioritization rules is related to a facial emotion status of the avatar of one of the participants.

### Claim 19 (depends on 11)

The method of claim 11, wherein one of the conditions indicated by the rendering prioritization rules is related to rendering resource loading of a participant's device relative to a threshold capacity level.

### Claim 20 (depends on 11)

The method of claim 11, wherein when rendering in the immersive XR environment the avatars representing the group of the participants and/or the virtual objects associated with the avatars, the operations prioritize rendering one of the virtual objects based on the rendering prioritization rules defining one of the following conditions that is determined to be satisfied:
the virtual object is touched by the avatar of a first participant among the group of participants;
the virtual object is within a threshold distance of the avatar of the first participant, wherein the threshold distance is defined by the rendering prioritization rules;
the virtual object is within a field of view, FOV, of a pose of the avatar in the immersive XR environment;
the virtual object is within a threshold angular offset from the FOV of the pose of the avatar of the first participant, wherein the threshold angular offset is defined by the rendering prioritization rules;
the virtual object is predicted to become within the FOV of the pose of the avatar of the first participant within a threshold time defined by the rendering prioritization rules; and
the virtual object is predicted to become within the threshold distance of the avatar of the first participant within the threshold time defined by the rendering prioritization rules.

### Claim at position 21

-23. (canceled)
