# US 2026/0038201 A1 · System and method of three-dimensional model interaction on low end devices with photorealistic visualization

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0038201 A1
- Document ID: US20260038201A1
- Status: Published application
- Kind: A1
- Application number: 19/355,097
- Filed: 2025-10-10
- Published: 2026-02-05
- Earliest claimed: 2022-08-31
- Assignees: Mersivx Ltd
- Applicants: Mersivx Ltd
- Inventors: Haim HELINGER; Alon DVIR; Uri ADAR
- Web page: https://patentgrep.com/patent/US20260038201A1

## CPC

- G06T 17/00: Three-dimensional [3D] modelling for computer graphics
- G06T 9/001: {Model-based coding, e.g. wire frame}
- G06T 15/20: Perspective computation
- G06T 19/003: {Navigation within 3D models or images}
- G06T 19/20: Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts
- G06T 2210/08: Bandwidth reduction
- G06T 2219/024: Multi-user, collaborative environment
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

Systems and methods for rendering a three-dimensional (3D) environment in real time may include: rendering, by at least one first computing device, a 3D environment model to generate a visual representation of the environment, wherein the visual representation includes a plurality of frames corresponding to a plurality of locations within the 3D environment model; selecting, by at least one second computing device, a portion of a frame of the visual representation for display to a user; aligning, by the at least one second computing device, a corresponding user coordinate of the 3D environment model with the selected frame of the visual representation, based on the plurality of locations; and aligning, by the at least one second computing device, a corresponding field of view within the 3D environment model with the selected portion of the frame.

## Claims

### Claim 1

A method of generating an interactable three-dimensional (3D) environment, the method comprising:
rendering, by at least one first computing device, a 3D environment model to generate a visual representation of the interactable 3D environment, wherein the visual representation comprises a plurality of frames corresponding to a plurality of locations within the 3D environment model;
selecting, by at least one second computing device in communication with the at least one first computing device, a portion of a frame of the visual representation for display to a user;
aligning, by the at least one second computing device, a corresponding user coordinate of the 3D environment model with the selected frame of the visual representation, based on the plurality of locations; and
aligning, by the at least one second computing device, a corresponding field of view within the 3D environment model with the selected portion of the selected frame.

### Claim 2 (depends on 1)

The method of claim 1, further comprising:
compressing, by the at least one first computing device, the 3D environment model to produce a compressed 3D structural model; and
compressing, by the at least one first computing device, the visual representation to produce a compressed visual representation for use by the at least one second computing device.

### Claim 3 (depends on 2)

The method of claim 2, wherein the 3D environment model is compressed such that only a single characteristic of the 3D environment model is kept for at least one of: interaction, highlight based on alignment between the 3D model and the field of view, and real-time rendering.

### Claim 4 (depends on 2)

The method of claim 2, further comprising:
rendering, by the at least one second computing device, at least part of the compressed 3D structural model to generate a visual overlay layer, based on the corresponding user coordinate; and
selecting, by the at least one second computing device, a portion of the visual overlay layer for display to the user, based on the corresponding field of view.

### Claim 5 (depends on 4)

The method of claim 4, wherein the visual overlay layer comprises at least one of: an object, an object outline, a line, a texture, a video, an image, a material surface, an avatar, and an object with physics behavior.

### Claim 6 (depends on 4)

The method of claim 4, wherein the visual overlay layer comprises a plurality of dynamic objects interacting with other dynamic objects.

### Claim 7 (depends on 4)

The method of claim 4, wherein the visual overlay layer is generated in real-time in accordance with a current position and viewing angle of a corresponding user.

### Claim 8 (depends on 1)

The method of claim 1, wherein each of the plurality of locations is adjacent to at least one other location, such that the plurality of locations forms at least one path, wherein the at least one path represents continuous movement through the interactable 3D environment.

### Claim 9 (depends on 8)

The method of claim 8, wherein at least one of the plurality of locations is outside of the path, and wherein the visual representation is generated by 360-degree images, Gaussian Splatting or both.

### Claim 10 (depends on 1)

The method of claim 1, wherein multiple users share their view and/or their 3D position by sharing only basic 3D data.

### Claim 11 (depends on 2)

The method of claim 2, wherein at least one of the visual representation and the compressed 3D structural model comprise a plurality of layers, wherein each layer of the plurality of layers comprises different structures of the interactable 3D environment.

### Claim 12 (depends on 2)

The method of claim 2, further comprising:
replacing, by the at least one first computing device, at least one pixel of each frame of the plurality of frames with at least one identification (ID) pixel, the ID pixel indicative of a location of that frame; and
extracting, by the at least one second computing device, at least one ID pixel from the selected frame of the visual representation;
wherein aligning the corresponding user coordinate of the compressed 3D structural model with the selected frame of the visual representation is based on the extracted at least one ID pixel.

### Claim 13 (depends on 1)

The method of claim 1, wherein generating the 3D environment model is carried out with an Artificial Intelligence (AI) model.

### Claim 14 (depends on 1)

The method of claim 1, wherein selecting the selected portion of the selected frame of the visual representation for display to the user is based on a user input to at least one user input device.

### Claim 15 (depends on 1)

The method of claim 1, wherein each frame of the visual representation comprises a spherical image.

### Claim 16 (depends on 1)

The method of claim 1, wherein selecting the selected portion of the selected frame of the visual representation comprises:
generating a new frame corresponding to a new location, using an off-axis mathematical projection, wherein the off-axis mathematical projection is based on at least one existing frame of the plurality of frames; and
selecting a portion of the new frame.

### Claim 17

A system for generating an interactable three-dimensional (3D) environment, the system comprising;
at least one first computing device comprising:
a first memory; and
a first processor, the first processor configured to;
render a 3D environment model to generate a visual representation of the interactable 3D environment, wherein the visual representation comprises a plurality of frames corresponding to a plurality of locations within the 3D environment model;
at least one second computing device, in communication with the at least one first computing device, comprising:
a second memory; and
a second processor, the second processor configured to;
select a portion of a frame of the visual representation for display to a user;
align a corresponding user coordinate of the 3D environment model with the selected frame of the visual representation, based on the plurality of locations; and
align a corresponding field of view within the 3D environment model with the selected portion of the selected frame.

### Claim 18 (depends on 17)

The system of claim 17, wherein the at least one first computing device is further configured to:
compress the 3D environment model to produce a compressed 3D structural model; and
compress the visual representation to produce a compressed visual representation for use by the at least one second computing device.

### Claim 19 (depends on 18)

The system of claim 18, wherein the at least one first computing device is further configured to compress the 3D environment model such that only a single characteristic of the 3D environment model is kept for at least one of: interaction, highlight based on alignment between the 3D model and the field of view, and real-time rendering.

### Claim 20 (depends on 17)

The system of claim 17, wherein the at least one second computing device is further configured to:
render at least part of the compressed 3D structural model to generate a visual overlay layer, based on the corresponding user coordinate;
align the visual overlay layer with the corresponding selected frame of the visual representation; and
select a portion of the visual overlay layer for display to the user, based on the corresponding field of view.
