# US 2020/0402288 A1 · Systems, methods and apparatus for implementing tracked data communications on a chip

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0402288 A1
- Document ID: US20200402288A1
- Status: Published application
- Kind: A1
- Application number: 16/904,033
- Filed: 2020-06-17
- Published: 2020-12-24
- Earliest claimed: 2019-06-18
- Assignees: TMRW Foundation IP & Holding S. À R.L.
- Applicants: TMRW Foundation IP & Holding S. À R.L.
- Inventors: Cevat Yerli
- Web page: https://patentgrep.com/patent/US20200402288A1

## CPC

- G01S 19/48: by combining or switching between position solutions derived from the satellite radio beacon positioning system and position solutions derived from a further system
- G06T 15/005: {General purpose rendering architectures}
- A63F 13/211: using inertial sensors, e.g. accelerometers or gyroscopes
- A63F 13/213: comprising photodetecting means, e.g. cameras, photodiodes or infrared cells (A63F13/219 takes precedence)
- A63F 13/216: using geographical information, e.g. location of the game device or player using GPS
- A63F 13/57: Simulating properties, behaviour or motion of objects in the game world, e.g. computing tyre load in a car race game (A63F13/56 takes precedence)
- A63F 13/65: automatically by game devices or servers from real world data, e.g. measurement in live racing competition
- G01S 5/186: {Determination of attitude (using inertial means G01C9/00; control of attitude G05D1/49)}
- G01S 19/41: Differential correction, e.g. DGPS [differential GPS]
- G06F 3/0346: with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
- H04W 4/029: Location-based management or tracking services
- H10W 90/00: Package configurations
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06T 2215/16: Using real world measurements to influence rendering
- H10W 72/01: {Manufacture or treatment}
- H10W 90/293: {characterised by non-galvanic coupling between the chips, e.g. capacitive coupling}
- H10W 90/297: {characterised by the through-semiconductor vias [TSVs] in the stacked chips}
- H10W 90/724: {between a chip and a stacked insulating package substrate, interposer or RDL}
- G01S: RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- A63F: CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- H04W: WIRELESS COMMUNICATION NETWORKS (broadcast communication H04H; communication systems using wireless links for non-selective communication, e.g. wireless extensions H04M1/72)
- H10W: GENERIC PACKAGES, INTERCONNECTIONS, CONNECTORS OR OTHER CONSTRUCTIONAL DETAILS OF DEVICES COVERED BY CLASS H10

## Abstract

An electronic chip, chip assembly, device, system, and method enabling tracked data communications. The electronic chip comprises a plurality of processing cores and at least one hardware interface coupled to at least one of the one or more processing cores. At least one processing core implements a game and/or simulation engine, at least one processing core implements a position engine, and at least one processing core implements a gyroscope and, optionally, an IMU. The at least one position engine obtains pose data from an external positioning system comprising GNSS augmented by millimeter-wave cellular networks and/or Wi-Fi; and internal pose data from the gyroscope, optional IMU, and game and/or simulation engine, the data comprising inertial, 3D structure, and simulation data, thereby computing a 6 DOF pose of the client device, driving processing of 3D applications by the one or more game and/or simulation engine.

## Claims

### Claim 1

A chip comprising:
a plurality of processing cores; and
at least one hardware interface coupled to at least one of the plurality of processing cores,
wherein at least one of the plurality of processing cores implements a first engine comprising at least one game engine or simulation engine,
wherein at least one of the plurality of processing cores implements a position engine,
wherein at least one of the plurality of processing cores implements at least one gyroscope core,
wherein the position engine is configured to obtain first positioning data from a global navigation satellite system (GLASS) and compute, through one or more hardwired algorithms, an initial position and orientation of a client device, and
wherein the position engine is configured to augment the initial position and orientation based on second positioning data received from a cellular positioning system via the at least one hardware interface, based on third positioning data received from one or more short range communication systems, and based on orientational data received from one or more gyroscopes, and by performing virtual world system computations, obtaining a refined 6 degrees of freedom (6 DOF) position and orientation.

### Claim 2 (depends on 1)

The chip of claim 1, further comprising a memory, wherein one or more of the plurality of processing cores are configured to generate position and orientation data and to provide the data to the position engine via the memory.

### Claim 3 (depends on 1)

The chip of claim 1, wherein one or more of the plurality of processing cores implement one or more of a CPU or GPU configured to assist in processing of the first engine and the position engine.

### Claim 4 (depends on 1)

The chip of claim 1, wherein at least one of the plurality of processing cores implements an inertia measuring unit (IMU) configured to obtain further 6 DOF positioning data.

### Claim 5 (depends on 1)

The chip of claim 1, wherein the first engine and the position engine are coupled into a single engine processing core.

### Claim 6 (depends on 5)

The chip of claim 5, wherein the first engine is subdivided into dedicated hardware components comprising one or more of a 3D structures-and-physics engine, a simulation processor or a dedicated rendering engine implemented on the single engine processing core.

### Claim 7 (depends on 1)

The chip of claim 1, wherein the first positioning data, the second positioning data, the third positioning data, the orientational data, and the virtual world system computations enable different, complementary positioning update rates.

### Claim 8 (depends on 1)

The chip of claim 1, wherein the chip is configured to share computed 6 DOF positioning data through either of the position engine through the GNSS network, or through the at least one hardware interface using a cellular communications network or the one or more short range communication systems.

### Claim 9 (depends on 1)

The chip of claim 1, wherein at least one of the plurality of processing cores implements a communications engine, and wherein the second positioning data and the third positioning data are received via the communications engine.

### Claim 10 (depends on 1)

The chip of claim 1, wherein the refined 6 DOF position and orientation used in operations of 3D applications executed by the first engine.

### Claim 11

A chip comprising:
a plurality of processing cores; and
at least one hardware interface coupled to at least one of the plurality of processing cores,
wherein at least one of the plurality of processing cores implements a first engine comprising at least one game engine or simulation engine,
wherein at least one of the plurality of processing cores implements at least one position and communications engine,
wherein at least one of the plurality of processing cores implements at least one gyroscope core,
wherein the at least one position and communications engine is configured to obtain first positioning data from a cellular positioning system via the at least one hardware interface and compute an initial position and orientation of a client device,
wherein the at least one position and communications engine is configured to augment the initial position and orientation based on second positioning data received from one or more short range communication systems and orientational data received from one or more gyroscopes, and by performing virtual world system computations, obtaining a refined 6 degrees of freedom (6 DOF) position and orientation.

### Claim 12 (depends on 11)

The chip of claim 11, further comprising a memory, wherein one or more of the plurality of processing cores are configured to generate position and orientation data and to provide the position and orientation data to the at least one position and communications engine via the memory.

### Claim 13 (depends on 11)

The chip of claim 11, wherein at least one of the plurality of processing cores implements an inertia measuring unit (IMU) configured to obtain further 6 DOF positioning data.

### Claim 14 (depends on 11)

The chip of claim 11, wherein the first engine and the at least one position and communications engine are coupled into a single engine processing core.

### Claim 15 (depends on 14)

The chip of claim 14, wherein the first engine is subdivided into dedicated hardware components comprising one or more of a 3D structures-and-physics engine, a simulation processor, or a dedicated rendering engine implemented on the single engine processing core.

### Claim 16 (depends on 11)

The chip of claim 11, wherein the first positioning data, the second positioning data, the orientational data, and the virtual world system computations enable different, complementary positioning update rates. 17, The chip of claim 11, wherein the chip is configured to share computed 6 DOF positioning data through the position and communications engine using a cellular communications network or the short range communication systems.

### Claim 18 (depends on 11)

The chip of claim 11, wherein the refined 6 DOF position and orientation is used in operations of 3D applications executed by the first engine.

### Claim 19 (depends on 11)

A mobile computing device comprising the chip of claim 11.

### Claim 20

A method comprising:
requesting, by a data tracking communications chip on a client device, wireless radio signals from one or more external positioning systems, wherein the data tracking communications chip comprises an internal positioning system;
computing, by the data tracking communications chip, an initial position of the client device using the internal positioning system, wherein the initial position of the client device is computed based at least in part on data obtained from the wireless radio signals;
refining the initial position of the client device by computing a 6 degree-of-freedom (6 DOF) position and orientation of the client device; and
updating one or more 3D applications, by the data tracking communications chip, based on the computed 6 DOF position and orientation of the client device.
