# US 2019/0318541 A1 · Augmented Reality Campus Assistant

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0318541 A1
- Document ID: US20190318541A1
- Status: Published application
- Kind: A1
- Application number: 16/382,122
- Filed: 2019-04-11
- Published: 2019-10-17
- Earliest claimed: 2018-04-12
- Assignees: PRO Unlimited Global Solutions, Inc.
- Applicants: PRO Unlimited Global Solutions, Inc.
- Inventors: Ted Sergott; Brad Martin
- Web page: https://patentgrep.com/patent/US20190318541A1

## CPC

- G06T 11/00: Two-dimensional [2D] image generation
- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- H04L 67/131: Protocols for games, networked simulations or virtual reality
- H04W 4/025: {using location based information parameters}
- H04W 4/029: Location-based management or tracking services
- H04L 67/306: User profiles
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)
- H04W: WIRELESS COMMUNICATION NETWORKS (broadcast communication H04H; communication systems using wireless links for non-selective communication, e.g. wireless extensions H04M1/72)

## Abstract

This invention relates to information processing systems and methods in a workplace environment. More particularly, the invention relates to systems and methods for displaying information for use by human users in a workplace environment. Such methods and systems may include an augmented reality mobile device application with voice interactive and other features including user-selectable buttons. Such methods and systems provide rich real-time information to the user via composited media content, overlay imagery, and acoustic speakers. Composited media content may include interactive maps, calendaring functions, navigation information, and tools to assist with management of assignment information. The augmented reality methods and systems facilitate access to various locations and resources at given workplace campus.

## Claims

### Claim 1

A computerized method comprising:
a. capturing media content of a trigger image at a workplace environment with a camera of a mobile device;
b. determining a location of the mobile device when the media content is captured;
c. determining a direction that a lens of the camera is facing when the media content is captured;
d. identifying one or more trigger images based on the location and the direction of the mobile device;
e. downloading, into the mobile device from a server, overlay imagery derived from workplace activity;
f. compositing the overlay imagery onto the media content to create composited media content; and
g. displaying the composited media content on a display of the mobile device.

### Claim 2 (depends on 1)

The computerized method of claim 1, wherein the determining of the location of the mobile device comprises determining the location of the mobile device with a global positioning system module of the mobile device.

### Claim 3 (depends on 1)

The computerized method of claim 1, wherein the determining of the location of the mobile device comprises determining the location of the mobile device using a cellular infrastructure to triangulate the location of the mobile device.

### Claim 4 (depends on 1)

The computerized method of claim 1, wherein identifying the one or more trigger images comprises:
a. transmitting the location and the direction to the server; and
b. receiving an identification of the one or more trigger images from the server.

### Claim 5 (depends on 1)

The computerized method of claim 1, wherein the overlay imagery is derived from past workplace activities of at least one user.

### Claim 6 (depends on 5)

The computerized method of claim 5, wherein past workplace activities comprise the past workplace activity of a single user of the mobile device, wherein the past workplace activity of the single user is retrieved from at least one of a user tracking account provided by the workplace or a user account provided by a manufacturer of the one or more trigger images.

### Claim 7 (depends on 1)

The computerized method of claim 1, wherein overlay imagery comprises active information.

### Claim 8 (depends on 7)

The computerized method of claim 7, wherein active information comprises local user building access history information.

### Claim 9

A computerized method comprising:
a. capturing media content at a workplace with a camera of a mobile device of a user at the workplace;
b. capturing media content of at least one trigger image in the workplace with the camera of the mobile device;
c. decoding the trigger image to determine a location and a position of the mobile device;
d. identifying the trigger image based on the location and the direction;
e. identifying a workplace user at a workplace when the media content is captured;
f. downloading, into the mobile device from a server, overlay imagery derived from workplace activity of the workplace user;
g. overlaying the overlay imagery onto the media content to create a composited media content; and
h. displaying the composited media content on a display on the mobile device.

### Claim 10 (depends on 9)

The computerized method of claim 9, wherein identifying the trigger image comprises:
a. transmitting the captured media content to the server; and
b. receiving an identification of the trigger image from a trigger image database.

### Claim 11 (depends on 9)

The computerized method of claim 9, wherein identifying the trigger image comprises:
a. transmitting the location and the direction of the mobile device to the server;
b. receiving an identification of the trigger image from the server.

### Claim 12 (depends on 9)

The computerized method of claim 9, wherein identifying the workplace user comprises identifying the workplace user based on an identification of the trigger image and/or the user assignment history information.

### Claim 13 (depends on 9)

The computerized method of claim 9, wherein identifying the workplace user comprises:
a. extracting an image, from the media content, of a display of the trigger image and/or user via the user assignment history;
b. locating a distinctive feature in the image and/or the user assignment history; and
c. identifying the workplace user based on the distinctive feature in the image.

### Claim 14 (depends on 9)

The computerized method of claim 9, wherein the overlay imagery is derived from the user's building access history information.

### Claim 15 (depends on 9)

The computerized method of claim 9, wherein the overlay imagery is derived from user navigation history information.

### Claim 16 (depends on 9)

The computerized method of claim 9, wherein the overlay imagery is derived from user voice command history information.

### Claim 17 (depends on 9)

The computerized method of claim 9, wherein the overlay imagery is derived from user assignment history information and/or user current assignment information.

### Claim 18 (depends on 9)

The computerized method of claim 9, wherein the overlay imagery is derived from user button selection history information.

### Claim 19

An augmented reality system comprising:
a. a server connected to a network, the server receiving requests from users via the network, the server comprising:
i. at least one processor;
ii. a database for storing trigger image information; and
iii. a memory operatively coupled to the processor, the memory storing program instructions that when executed by the processor, causes the processor to:
1. receive a trigger image from a user via the network;
2. determine overlay imagery about the trigger image from the trigger image database based on the request; and
3. send the overlay imagery to the user via the network.
