# US 2020/0394846 A1 · Methods and Systems for Tailoring an Extended Reality Overlay Object

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0394846 A1
- Document ID: US20200394846A1
- Status: Published application
- Kind: A1
- Application number: 17/005,032
- Filed: 2020-08-27
- Published: 2020-12-17
- Earliest claimed: 2019-01-29
- Assignees: Verizon Patent and Licensing Inc.
- Applicants: Verizon Patent and Licensing Inc.
- Inventors: Layton R. Diament; Michael Y. Huang
- Web page: https://patentgrep.com/patent/US20200394846A1

## CPC

- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80)
- G06T 17/05: Geographic models
- H04N 13/279: the virtual viewpoint locations being selected by the viewers or determined by tracking
- H04N 13/293: Generating mixed stereoscopic images; Generating mixed monoscopic and stereoscopic images, e.g. a stereoscopic image overlay window on a monoscopic image background
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

An exemplary extended reality presentation system determines that a depiction of an augmentable object within a field of view takes up a first portion of the field of view, and, in response to this determination, presents a first form of an overlay object within the field of view. The first form of the overlay object is graphically associated with the augmentable object. During the presenting of the first form of the overlay object within the field of view, the system determines that the depiction of the augmentable object has come to take up a second portion of the field of view, and, in response to this determination, replaces the first form of the overlay object with a second form of the overlay object within the field of view. The second form of the overlay object is distinct from the first form. Corresponding methods and systems are also disclosed.

## Claims

### Claim 1

A method comprising:
determining, by an extended reality presentation system, that a depiction of an augmentable object within a field of view takes up a first portion of the field of view;
presenting within the field of view, by the extended reality presentation system in response to the determining that the depiction of the augmentable object takes up the first portion of the field of view, a first form of an overlay object graphically associated with the augmentable object;
determining, by the extended reality presentation system during the presenting of the first form of the overlay object within the field of view, that the depiction of the augmentable object has come to take up a second portion of the field of view; and
replacing within the field of view, by the extended reality presentation system in response to the determining that the depiction of the augmentable object has come to take up the second portion of the field of view, the first form of the overlay object with a second form of the overlay object distinct from the first form.

### Claim 2 (depends on 1)

The method of claim 1, wherein:
the first form of the overlay object is tailored to a first apparent proximity of the augmentable object to a user of the extended reality presentation system, the first apparent proximity represented by the first portion of the field of view determined to be taken up by the depiction of the augmentable object; and
the second form of the overlay object is tailored to a second apparent proximity of the augmentable object to the user, the second apparent proximity represented by the second portion of the field of view that the depiction of the augmentable object is determined to have come to take up during the presenting of the first form of the overlay object.

### Claim 3 (depends on 2)

The method of claim 2, wherein:
the first apparent proximity serves as a proxy for a first actual proximity of the augmentable object to the user, the first apparent proximity approximating the first actual proximity while not perfectly corresponding to the first actual proximity; and
the second apparent proximity serves as a proxy for a second actual proximity of the augmentable object to the user, the second apparent proximity approximating the second actual proximity while not perfectly corresponding to the second actual proximity.

### Claim 4 (depends on 1)

The method of claim 1, further comprising:
presenting, by the extended reality presentation system to the user, the field of view as a field of view into an extended reality world; and
identifying, by the extended reality presentation system, the augmentable object from a set of objects presented in the field of view into the extended reality world;
wherein the determining that the depiction of the augmentable object takes up the first portion of the field of view is performed in response to the identifying of the augmentable object.

### Claim 5 (depends on 4)

The method of claim 4, further comprising:
determining, by the extended reality presentation system concurrent with the presenting of the field of view and prior to the identifying of the augmentable object, that the augmentable object is included within the extended reality world outside the field of view; and
presenting within the field of view, by the extended reality presentation system in response to the determining that the augmentable object is included within the extended reality world outside the field of view, a preview form of the overlay object to be graphically associated with the augmentable object when the augmentable object is subsequently presented in the field of view.

### Claim 6 (depends on 5)

The method of claim 5, wherein the determining that the augmentable object is included within the extended reality world outside the field of view comprises comparing:
real-time geolocation data generated by a sensor of the extended reality presentation system for the extended reality presentation system; and
real-time geolocation data accessed by the extended reality presentation system for the augmentable object.

### Claim 7 (depends on 1)

The method of claim 1, wherein the first and second forms of the overlay object are graphically associated with the augmentable object by being displayed directly on or adjacent to a target area of the augmentable object as the augmentable object moves within the field of view.

### Claim 8 (depends on 1)

The method of claim 1, wherein the first and second forms of the overlay object are dynamically-scaled forms of the overlay object that continuously scale with a target area of the augmentable object.

### Claim 9 (depends on 1)

The method of claim 1, wherein:
the extended reality presentation system is a mixed reality presentation system;
the field of view depicts an extended reality world comprising an augmented version of a real-world environment in which a user of the extended reality presentation system is located; and
the method further comprises presenting, by the extended reality presentation system, the field of view to the user, the presenting including displaying the overlay object on a heads-up display screen that provides a view of the overlay object integrated with the real-world environment.

### Claim 10 (depends on 1)

The method of claim 1, wherein:
the first portion of the field of view that the depiction of the augmentable object is determined to take up is representative of a first apparent proximity of the augmentable object to a user of the extended reality presentation system;
the second portion of the field of view that the depiction of the augmentable object is determined to have come to take up is representative of a second apparent proximity of the augmentable object to the user;
the method further comprises determining, by the extended reality presentation system, that the second apparent proximity satisfies a predetermined proximity threshold that is not satisfied by the first apparent proximity; and
the replacing within the field of view of the first form of the overlay object with the second form of the overlay object is performed in response to the determining that the second apparent proximity satisfies the predetermined proximity threshold.

### Claim 11 (depends on 1)

The method of claim 1, wherein the second form of the overlay object is distinct from the first form of the overlay object in at least one of the following ways:
the second form includes different content than the first form;
the second form includes a different type of content than the first form;
the second form includes a different design than the first form;
the second form is a different scale with respect to the augmentable object than the first form; or
the second form is graphically associated with the augmentable object in a different manner than the first form.

### Claim 12

A system comprising:
a memory storing instructions; and
a processor communicatively coupled to the memory and configured to execute the instructions to:
determine that a depiction of an augmentable object within a field of view takes up a first portion of the field of view;
present within the field of view, in response to the determining that the depiction of the augmentable object takes up the first portion of the field of view, a first form of an overlay object graphically associated with the augmentable object;
determine, during the presenting of the first form of the overlay object within the field of view, that the depiction of the augmentable object has come to take up a second portion of the field of view; and
replace within the field of view, in response to the determining that the depiction of the augmentable object has come to take up the second portion of the field of view, the first form of the overlay object with a second form of the overlay object distinct from the first form.

### Claim 13 (depends on 12)

The system of claim 12, wherein:
the first form of the overlay object is tailored to a first apparent proximity of the augmentable object to a user of the system, the first apparent proximity represented by the first portion of the field of view determined to be taken up by the depiction of the augmentable object; and
the second form of the overlay object is tailored to a second apparent proximity of the augmentable object to the user, the second apparent proximity represented by the second portion of the field of view that the depiction of the augmentable object is determined to have come to take up during the presenting of the first form of the overlay object.

### Claim 14 (depends on 13)

The system of claim 13, wherein:
the first apparent proximity serves as a proxy for a first actual proximity of the augmentable object to the user, the first apparent proximity approximating the first actual proximity while not perfectly corresponding to the first actual proximity; and
the second apparent proximity serves as a proxy for a second actual proximity of the augmentable object to the user, the second apparent proximity approximating the second actual proximity while not perfectly corresponding to the second actual proximity.

### Claim 15 (depends on 12)

The system of claim 12, wherein:
the processor is further configured to execute the instructions to:
present the field of view to the user as a field of view into an extended reality world, and
identify the augmentable object from a set of objects presented in the field of view into the extended reality world; and
the determining that the depiction of the augmentable object takes up the first portion of the field of view is performed in response to the identifying of the augmentable object.

### Claim 16 (depends on 15)

The system of claim 15, wherein the processor is further configured to execute the instructions to:
determine, concurrent with the presenting of the field of view and prior to the identifying of the augmentable object, that the augmentable object is included within the extended reality world outside the field of view; and
present within the field of view, in response to the determining that the augmentable object is included within the extended reality world outside the field of view, a preview form of the overlay object to be graphically associated with the augmentable object when the augmentable object is subsequently presented in the field of view.

### Claim 17 (depends on 12)

The system of claim 12, wherein the first and second forms of the overlay object are:
graphically associated with the augmentable object by being displayed directly on or adjacent to a target area of the augmentable object as the augmentable object moves within the field of view; and
dynamically-scaled forms of the overlay object that continuously scale with a target area of the augmentable object.

### Claim 18 (depends on 12)

The system of claim 12, wherein:
the system is a mixed reality presentation system;
the field of view depicts an extended reality world comprising an augmented version of a real-world environment in which a user of the mixed reality presentation system is located; and
the processor is further configured to execute the instructions to present the field of view to the user, the presenting including displaying the overlay object on a heads-up display screen that provides a view of the overlay object integrated with the real-world environment.

### Claim 19 (depends on 12)

The system of claim 12, wherein:
the first portion of the field of view that the depiction of the augmentable object is determined to take up is representative of a first apparent proximity of the augmentable object to a user of the system;
the second portion of the field of view that the depiction of the augmentable object is determined to have come to take up is representative of a second apparent proximity of the augmentable object to the user;
the processor is further configured to execute the instructions to determine that the second apparent proximity satisfies a predetermined proximity threshold that is not satisfied by the first apparent proximity; and
the replacing within the field of view of the first form of the overlay object with the second form of the overlay object is performed in response to the determining that the second apparent proximity satisfies the predetermined proximity threshold.

### Claim 20

A non-transitory computer-readable medium storing instructions that, when executed, direct a processor of a computing device to:
determine that a depiction of an augmentable object within a field of view takes up a first portion of the field of view;
present within the field of view, in response to the determining that the depiction of the augmentable object takes up the first portion of the field of view, a first form of an overlay object graphically associated with the augmentable object;
determine, during the presenting of the first form of the overlay object within the field of view, that the depiction of the augmentable object has come to take up a second portion of the field of view; and
replace within the field of view, in response to the determining that the depiction of the augmentable object has come to take up the second portion of the field of view, the first form of the overlay object with a second form of the overlay object distinct from the first form.
