# US 2026/0289924 A1 · System and method for implementing computer-simulated reality interactions between users and publications

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0289924 A1
- Document ID: US20260289924A1
- Status: Published application
- Kind: A1
- Application number: 19/638,446
- Filed: 2026-04-03
- Published: 2026-09-24
- Earliest claimed: 2016-06-03
- Assignees: A Big Chunk of Mud LLC
- Applicants: A Big Chunk of Mud LLC
- Inventors: J. Michelle Haines
- Web page: https://patentgrep.com/patent/US20260289924A1

## CPC

- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- G06F 16/48: Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
- G06V 20/20: in augmented reality scenes
- G06V 2201/02: Recognising information on displays, dials, clocks
- G06V 2201/131: Book
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

Methods, systems, and media for enhancing one or more publications by receiving live video captured by a user, the live video comprising video of a publication, the publication comprising copyrighted content; identifying at least one first trigger in the live video, identifying one or more first three-dimensional, interactive media associated with the at least one first trigger and pertaining to the copyrighted content, and presenting to the user the first three-dimensional, interactive media; and identifying at least one second trigger in the first three-dimensional, interactive media, identifying one or more second three-dimensional, interactive media associated with the at least one second trigger and pertaining to the copyrighted content, and presenting to the user the second three-dimensional, interactive media to progressively deepen and enrich the engagement with the copyrighted content of the publication.

## Claims

### Claim 1

A computer-implemented method for implementing computer-simulated reality interactions between a user and a physical environment, the method comprising:
launching, with a computing system, an application on a visual output device having a camera and a display;
determining, with the computing system via a location-based service of the visual output device, that the visual output device has entered a location;
identifying, in response to the location determination, at least one non-visual trigger associated with the location;
receiving, by a computer vision system of the visual output device, data about the location;
presenting, on the visual output device as a virtual overlay aligned with a field of view of the user in relation to the location, a first computer-simulated reality environment;
detecting a second trigger in the first computer-simulated reality environment based on at least one of a user response, a gesture, an eye movement and a duration of interaction with the first computer-simulated reality environment; and
shifting a presentation from the first computer-simulated reality environment to one of a second computer-simulated reality environment and a mixed-reality environment based on the second trigger.

### Claim 2 (depends on 1)

The method of claim 1, wherein the visual output device is one of a tablet and a smartphone adapted as part of an augmented reality system.

### Claim 3 (depends on 1)

The method of claim 1, wherein the visual output device is one of a pair of smart glasses and a head-mounted display.

### Claim 4 (depends on 1)

The method of claim 1, wherein the shifting further comprising one of shifting from an augmented reality to a virtual reality and shifting from the augmented reality to a mixed reality.

### Claim 5 (depends on 1)

The method of claim 1, wherein the second computer-simulated reality environment includes 360-degree immersive content.

### Claim 6 (depends on 1)

The method of claim 1, wherein multiple physical objects or multiple publications in the physical environment are used in combination to trigger a combined computer-simulated reality experience.

### Claim 7 (depends on 1)

The method of claim 1, wherein the visual output device executes instructions locally.

### Claim 8 (depends on 1)

The method of claim 1, wherein the visual output device is in wireless communication with a secondary device.

### Claim 9 (depends on 1)

The method of claim 1, wherein the first trigger is based on visual feature detection on one of a publication, an object and a surface.

### Claim 10 (depends on 1)

The method of claim 1, wherein the second trigger is based on an eye movement.

### Claim 11 (depends on 1)

The method of claim 1, wherein the second trigger comprises a touchscreen input.

### Claim 12 (depends on 11)

The method of claim 11, wherein the second computer-simulated reality environment enables the user to interact with one of a virtual character and a virtual object via the touchscreen.

### Claim 13 (depends on 1)

The method of claim 1, wherein the field of view of the user is determined based on one or more images captured of the user's eyes.

### Claim 14 (depends on 1)

The method of claim 1, wherein the presentation of the first or second computer-simulated reality environment includes audio output aligned with the virtual overlay in the location.

### Claim 15 (depends on 1)

The method of claim 1, wherein the first trigger comprises a combination of the non-visual trigger and a visual feature detection of one of a physical object and a surface in the location.

### Claim 16 (depends on 1)

The method of claim 1, wherein the second trigger further comprises a proximity of the user to one of the location and a virtual entity.

### Claim 17

A computing system for implementing progressive computer-simulated reality interactions between a user and a physical environment, the system comprising:
a visual output device having a camera and display;
one or more processors;
a memory storing instructions; and
one or more sensors including at least a camera;
wherein the processor executes the instructions and the system is configured to:
launch an application on the visual output device;
determine, via a location-based service of the visual output device, that the visual output device has entered a location;
identify, in response to the location determination, at least one non-visual trigger associated with the location;
receive, from a computer vision system of the visual output device, data about the location;
present, on the visual output device as a virtual overlay aligned with a field of view of the user in relation to the location, a first computer-simulated reality environment;
detect a second trigger in the first computer-simulated reality environment based on at least one of a user response, a gesture, an eye movement and a duration of interaction with the first computer-simulated reality environment; and
shift a presentation from the first computer-simulated reality environment to one of a second computer-simulated reality environment and a mixed-reality environment based on the second trigger.

### Claim 18 (depends on 17)

The system of claim 17, wherein the visual output device comprises one of a pair of smart glasses and a head-mounted display.

### Claim 19 (depends on 17)

The system of claim 17, wherein the system further comprises radio-frequency receivers for trigger detection.

### Claim 20 (depends on 17)

The system of claim 17, wherein the system comprises two or more visual output devices.

### Claim 21

A non-transitory computer-readable medium storing instructions that, when executed by a visual output device having a camera and display, cause the device to perform a method comprising:
launching, with a computing system, an application on the visual output device;
determining, with the computing system via a location-based service of the visual output device, that the visual output device has entered a location;
identifying, in response to the location determination, at least one non-visual trigger associated with the location;
receiving, by a computer vision system of the visual output device, data about the location;
presenting, on the visual output device as a virtual overlay aligned with a field of view of the user in relation to the location, a first computer-simulated reality environment;
detecting a second trigger in the first computer-simulated reality environment based on at least one of a user response, a gesture, an eye movement and a duration of interaction with the first computer-simulated reality environment; and
shifting a presentation from the first computer-simulated reality environment to one of a second computer-simulated reality environment and a mixed-reality environment based on the second trigger.

### Claim 22 (depends on 21)

The medium of claim 21, wherein the instructions cause the device to execute locally.

### Claim 23 (depends on 21)

The medium of claim 21, wherein the instructions cause shifting from the first environment to the second environment without user-perceived interruption.
