# US 11,908,092 B2 · Collaborative augmented reality

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 11,908,092 B2
- Document ID: US11908092B2
- Status: Granted
- Kind: B2
- Application number: 17/971,848
- Filed: 2022-10-24
- Published: 2023-02-16
- Granted: 2024-02-20
- Earliest claimed: 2017-02-10
- Assignees: Open Text Corporation
- Applicants: Open Text Corporation
- Inventors: Sean Blanchflower; Timothy Halbert
- Web page: https://patentgrep.com/patent/US11908092B2

## CPC

- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- A63F 13/10
- A63F 13/12
- A63F 13/30: Interconnection arrangements between game servers and game devices; Interconnection arrangements between game devices; Interconnection arrangements between game servers
- A63F 13/45: Controlling the progress of the video game
- A63F 13/50: Controlling the output signals based on the game progress
- A63F 13/65: automatically by game devices or servers from real world data, e.g. measurement in live racing competition
- A63F 13/655: by importing photos, e.g. of the player
- G06F 3/1438: {using more than one graphics controller}
- G06F 3/1462: {with means for detecting differences between the image stored in the host and the images displayed on the remote displays}
- G06T 15/20: Perspective computation
- G06V 10/751: {Comparing pixel values or logical combinations thereof, or feature values having positional relevance, e.g. template matching}
- G06V 20/80: Recognising image objects characterised by unique random patterns
- A63F 2300/1093: using visible light
- A63F 2300/5533: using program state or machine event data, e.g. server keeps track of the state of multiple players on in a multiple player game
- A63F 2300/69: Involving elements of the real world in the game world, e.g. measurement in live races, real video
- G06T 2219/024: Multi-user, collaborative environment
- G06V 10/40: Extraction of image or video features
- G06V 20/46: {Extracting features or characteristics from the video content, e.g. video fingerprints, representative shots or key frames}
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- A63F: CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

Augmented reality presentations are provided at respective electronic devices. A first electronic device receives information relating to modification made to an augmented reality presentation at a second electronic device, and the first electronic device modifies the first augmented reality presentation in response to the information.

## Claims

### Claim 1

A method, comprising:
during a collaborative augmented reality session that involves multiple electronic devices capturing a physical target or a replica of the physical target, receiving, by a computer, modification information on collaborative modifications made at the multiple electronic devices;
storing, by the computer, the modification information as state information regarding the collaborative augmented reality session;
determining, by the computer, that an additional electronic device has captured a physical target or a replica of the physical target that is the same as the physical target or the replica of the physical target captured by the multiple electronic devices;
connecting, by the computer, the additional electronic device to the collaborative augmented reality session; and
providing, by the computer, the state information regarding the collaborative augmented reality session to the additional electronic device.

### Claim 2 (depends on 1)

The method according to claim 1, wherein the determining comprises receiving an image or a video from the additional electronic device and wherein the image or the video received from the additional electronic device contains a perspective of the physical target or the replica of the physical target.

### Claim 3 (depends on 2)

The method according to claim 2, wherein the perspective of the physical target or the replica of the physical target is different from perspectives of the physical target or the replica of the physical target seen by the multiple electronic devices.

### Claim 4 (depends on 1)

The method according to claim 1, wherein the computer comprises one of the multiple electronic devices or an augmented reality server.

### Claim 5 (depends on 1)

The method according to claim 1, wherein the computer comprises one of the multiple electronic devices configured as an augmented reality server.

### Claim 6 (depends on 1)

The method according to claim 1, further comprising:
determining that no additional electronic device has been added to the collaborative augmented reality session; and
waiting for information reporting a modification made at any electronic device in the collaborative augmented reality session.

### Claim 7 (depends on 1)

The method according to claim 1, further comprising:
tracking movements of the multiple electronic devices based on detected poses of the multiple electronic devices relative to the physical target or the replica of the physical target captured by the multiple electronic devices.

### Claim 8

A system, comprising:
a processor;
a non-transitory computer-readable medium; and
instructions stored on the non-transitory computer-readable medium and translatable by the processor for:
during a collaborative augmented reality session that involves multiple electronic devices capturing a physical target or a replica of the physical target, receiving modification information on collaborative modifications made at the multiple electronic devices;
storing the modification information as state information regarding the collaborative augmented reality session;
determining that an additional electronic device has captured a physical target or a replica of the physical target that is the same as the physical target or the replica of the physical target captured by the multiple electronic devices;
connecting the additional electronic device to the collaborative augmented reality session; and
providing the state information regarding the collaborative augmented reality session to the additional electronic device.

### Claim 9 (depends on 8)

The system of claim 8, wherein the determining comprises receiving an image or a video from the additional electronic device and wherein the image or the video received from the additional electronic device contains a perspective of the physical target or the replica of the physical target.

### Claim 10 (depends on 9)

The system of claim 9, wherein the perspective of the physical target or the replica of the physical target is different from perspectives of the physical target or the replica of the physical target seen by the multiple electronic devices.

### Claim 11 (depends on 8)

The system of claim 8, wherein the system comprises one of the multiple electronic devices or an augmented reality server.

### Claim 12 (depends on 8)

The system of claim 8, wherein the system comprises one of the multiple electronic devices configured as an augmented reality server.

### Claim 13 (depends on 8)

The system of claim 8, where the instructions are further translatable by the processor for:
determining that no additional electronic device has been added to the collaborative augmented reality session; and
waiting for information reporting a modification made at any electronic device in the collaborative augmented reality session.

### Claim 14 (depends on 8)

The system of claim 8, where the instructions are further translatable by the processor for:
tracking movements of the multiple electronic devices based on detected poses of the multiple electronic devices relative to the physical target or the replica of the physical target captured by the multiple electronic devices.

### Claim 15

A computer program product comprising a non-transitory computer-readable medium storing instructions translatable by a processor for:
during a collaborative augmented reality session that involves multiple electronic devices capturing a physical target or a replica of the physical target, receiving modification information on collaborative modifications made at the multiple electronic devices;
storing the modification information as state information regarding the collaborative augmented reality session;
determining that an additional electronic device has captured a physical target or a replica of the physical target that is the same as the physical target or the replica of the physical target captured by the multiple electronic devices;
connecting the additional electronic device to the collaborative augmented reality session; and
providing the state information regarding the collaborative augmented reality session to the additional electronic device.

### Claim 16 (depends on 15)

The computer program product of claim 15, wherein the determining comprises receiving an image or a video from the additional electronic device and wherein the image or the video received from the additional electronic device contains a perspective of the physical target or the replica of the physical target.

### Claim 17 (depends on 16)

The computer program product of claim 16, wherein the perspective of the physical target or the replica of the physical target is different from perspectives of the physical target or the replica of the physical target seen by the multiple electronic devices.

### Claim 18 (depends on 15)

The computer program product of claim 15, wherein the processor is part of one of the multiple electronic devices or an augmented reality server.

### Claim 19 (depends on 15)

The computer program product of claim 15, where the instructions are further translatable by the processor for:
determining that no additional electronic device has been added to the collaborative augmented reality session; and
waiting for information reporting a modification made at any electronic device in the collaborative augmented reality session.

### Claim 20 (depends on 15)

The computer program product of claim 15, where the instructions are further translatable by the processor for:
tracking movements of the multiple electronic devices based on detected poses of the multiple electronic devices relative to the physical target or the replica of the physical target captured by the multiple electronic devices.
