# US 2020/0404447 A1 · Location-based application activation

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0404447 A1
- Document ID: US20200404447A1
- Status: Published application
- Kind: A1
- Application number: 16/902,024
- Filed: 2020-06-15
- Published: 2020-12-24
- Earliest claimed: 2019-06-18
- Assignees: TMRW Foundation IP & Holding S. À R.L.
- Applicants: TMRW Foundation IP & Holding S. À R.L.
- Inventors: Cevat Yerli
- Web page: https://patentgrep.com/patent/US20200404447A1

## CPC

- G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)}
- H04W 4/021: Services related to particular areas, e.g. point of interest [POI] services, venue services or geofences
- A63F 13/211: using inertial sensors, e.g. accelerometers or gyroscopes
- A63F 13/216: using geographical information, e.g. location of the game device or player using GPS
- A63F 13/355: Performing operations on behalf of clients with restricted processing capabilities, e.g. servers transform changing game scene into an encoded video stream for transmitting to a mobile phone or a thin client
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)}
- G06F 16/9535: Search customisation based on user profiles and personalisation
- G06F 16/9537: Spatial or temporal dependent retrieval, e.g. spatiotemporal queries
- G06T 19/003: {Navigation within 3D models or images}
- A63F 2300/8082: Virtual reality
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- H04W: WIRELESS COMMUNICATION NETWORKS (broadcast communication H04H; communication systems using wireless links for non-selective communication, e.g. wireless extensions H04M1/72)
- A63F: CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

A system and method enabling location-based activation of applications. A server system stores and provides a persistent virtual world system comprising one or more applications virtually attached to virtual-world entities positioned according to real-world coordinates, the server system being configured to compute the state of the virtual-world entities and to process the applications. Upon detecting the user devices in a corresponding zone (e.g., by the wireless network detecting user devices connecting to the server), the server system sends a minimum amount of application graphical representation to the user devices. Upon user interaction with the application graphical representation, the user devices download a minimum amount of application data, prompting the server system to determine suitable application media streams. The server system performs heavy-load computational tasks on the media streams and delivers the streams to the user devices, which perform lightweight computational tasks on the media content.

## Claims

### Claim 1

A system enabling location-based activation of applications, comprising:
one or more servers comprising a memory and a processor, the one or more servers storing and providing a persistent virtual world system including a virtual version of a real-world space, the virtual version comprising one or more applications virtually attached to virtual-world entities positioned according to real-world coordinates, and the one or more servers being configured at least to:
compute the state of the virtual-world entities;
responsive to detecting a user device entering a trigger zone associated with the one or more applications, send a minimum amount of application graphical representation to the user device via a wireless network;
responsive to detecting user interaction with the application graphical representation, signal the user device to download a minimum amount of application data and provide the minimum amount of application data to the user device;
responsive to detecting the minimum amount of application data has been downloaded, determine two or more media streams, wherein determining the two or more media streams signals the one or more servers to perform heavy-load computational tasks on respective application media content to be delivered to the user device.

### Claim 2 (depends on 1)

The system of claim 1, wherein determining the two or more media streams is based on user viewing position, orientation, or viewing angle, or a combination thereof.

### Claim 3 (depends on 1)

The system of claim 1 further comprising the user device connected to the one or more servers via a wireless network and configured to receive and execute the one or more applications, wherein receiving the application media content signals the user device to perform lightweight computational tasks on the media content in order to execute the one or more applications on the user device.

### Claim 4 (depends on 1)

The system of claim 1, wherein providing the minimum amount of application data comprises pre-processing, by the one or more servers, of the application media content, the pre-processing comprising at least sound and video compression operations.

### Claim 5 (depends on 1)

The system of claim 1, wherein the heavy-load computational tasks on the application media content comprise physics simulations, lighting, shadows simulations, or rendering, or combinations thereof.

### Claim 6 (depends on 1)

The system of claim 1, wherein the virtual-world entities to which the applications are virtually attached are virtual replicas of real-world objects, the virtual replicas comprising data and models that provide self-computing capabilities and autonomous behavior.

### Claim 7 (depends on 6)

The system of claim 6, wherein the virtual replicas represent elements connected to the persistent virtual world system and unconnected elements, the connected elements comprising computing devices.

### Claim 7 (depends on 1)

The system of claim 1, wherein the virtual-world entities to which the applications are virtually attached are fully virtual objects not existing in the real world.

### Claim 9 (depends on 1)

The system of claim 1, wherein the system is configured for user interactions with the one or more applications in in augmented reality, virtual reality, mixed reality, or combinations thereof.

### Claim 10 (depends on 1)

The system of claim 1, wherein the two or more media streams are further selected based on profile information of a user stored in the memory or obtained through social media networks.

### Claim 11

A computer-implemented method for enabling location-based activation of applications performed by a server system comprising one or more server computers, the computer-implemented method comprising:
providing, in the server system, a persistent virtual world system including a virtual version of a real-world space comprising one or more applications virtually attached to virtual-world entities positioned according to real-world coordinates;
receiving a location of one or more user devices;
determining whether the one or more user devices have entered an application trigger zone based at least in part on the location of the one or more user devices;
providing, upon receiving an indication of the one or more user devices entering the application trigger zone, a minimum amount of application graphical representation to the one or more user devices;
providing, upon interaction with the minimum amount of application graphical representation, a minimum amount of application downloadable data to the one or more user devices;
determining, upon download of the minimum amount of application downloadable data, two or more media streams;
performing, upon determining the two or more media streams, heavy-load computational tasks on media content; and
sending the media content and instructions to perform lightweight computational tasks thereon to the one or more user devices.

### Claim 12 (depends on 11)

The method of claim 11, wherein determining the two or more media streams is based on user viewing position, orientation, or viewing angle, or a combination thereof.

### Claim 13 (depends on 11)

The method of claim 11, wherein providing the minimum amount of application downloadable data comprises pre-processing application media content, the pre-processing comprising at least sound and video compression operations.

### Claim 14 (depends on 11)

The method of claim 11, wherein the heavy-load computational tasks on the media content comprise performing one or more of physics simulations, lighting, shadows simulations, or rendering, or combinations thereof.

### Claim 15 (depends on 11)

The method of claim 11, wherein the virtual-world entities to which the applications are virtually attached are virtual replicas of real-world objects, the virtual replicas comprising data and models that provide self-computing capabilities and autonomous behavior.

### Claim 16 (depends on 14)

The method of claim 14 wherein the virtual replicas represent elements connected to the persistent virtual world system and unconnected elements, the connected elements comprising computing devices.

### Claim 17 (depends on 11)

The method of claim 11, wherein the virtual-world entities to which the applications are virtually attached are fully virtual objects not existing in the real world.

### Claim 18 (depends on 11)

The method of claim 11, further comprising processing user interactions in one of an augmented reality, virtual reality, mixed reality, or combinations thereof.

### Claim 19 (depends on 11)

The method of claim 11, wherein the two or more media streams are further selected based on profile information of a user stored in the server system or obtained through social media networks.

### Claim 20

A computer-readable medium having stored thereon computer code configured to cause one or more computing devices to perform steps comprising:
providing a persistent virtual world system including a virtual version of a real-world space comprising one or more applications virtually attached to virtual-world entities positioned according to real-world coordinates;
receiving a location of one or more user devices;
determining whether the one or more user devices have entered an application trigger zone based at least in part on the location of the user device;
providing, upon the one or more user devices entering the application trigger zone, a minimum amount of application graphical representation to the one or more user devices;
providing, upon interaction with the minimum amount of application graphical representation, a minimum amount of application downloadable data to the one or more user devices;
determining, upon download of the minimum amount of application downloadable data, two or more media streams based on user information;
performing, upon determining the two or more media streams, heavy-load computational tasks on media content; and
sending the media content and instructions to perform lightweight computational tasks thereon to the one or more user devices.
