# US 2008/0186330 A1 · Three dimensional virtual rendering of a live event

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2008/0186330 A1
- Document ID: US20080186330A1
- Status: Published application
- Kind: A1
- Application number: 11/670,394
- Filed: 2007-02-01
- Published: 2008-08-07
- Earliest claimed: 2007-02-01
- Assignees: Sportvision, Inc.
- Inventors: Rand Pendleton; Kenneth A. Milnes; Marvin S. White
- Web page: https://patentgrep.com/patent/US20080186330A1

## CPC

- A63F 13/10
- A63F 13/52: involving aspects of the displayed game scene
- A63F 13/45: Controlling the progress of the video game
- A63F 13/65: automatically by game devices or servers from real world data, e.g. measurement in live racing competition
- A63F 13/803: Driving vehicles or craft, e.g. cars, airplanes, ships, robots or tanks
- G06T 13/20: Three-dimensional [3D] animation
- G06T 19/20: Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts
- A63F 13/211: using inertial sensors, e.g. accelerometers or gyroscopes
- A63F 13/216: using geographical information, e.g. location of the game device or player using GPS
- A63F 2300/66: for rendering three dimensional images
- G06T 2210/21: Collision detection, intersection
- G06T 2219/2016: Rotation, translation, scaling
- A63F: CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

A method is disclosed for three-dimensional rendering of a live event such as an automobile race over a client device such as a personal computer. Moving and stationary objects at the event may be rendered using computer-generated graphics of the moving and stationary objects and real time positional data giving the position of the moving objects over time. The positional data may be streamed to the client device and displayed in real time or substantially real time.

## Claims

### Claim 1

A method of adjusting data generated during an event, the data indicating a position of a moving object, the method comprising the steps of:
(a) determining whether the data indicates the moving object occupies at least partially the same space as a second object from the event; and
(b) adjusting the data for at least the moving object to move the moving object out of the same space occupied by the second object in the event it is determined in said step (a) that the data indicates the moving object at least partially occupies the same space as the second object.

### Claim 2 (depends on 1)

A method as recited in claim 1, further comprising the step (c) of receiving a prediction of the precision of the data indicating the positions of the moving and second objects.

### Claim 3 (depends on 2)

A method as recited in claim 2, said step (b) comprising the step of adjusting the data for at least the moving object based on the predictions of the precision of the data received in said step (c).

### Claim 4 (depends on 2)

A method as recited in claim 2, said step (b) comprising the step of adjusting the data for at least the moving object to move the moving object an amount proportional to a ratio of the predictions of the precision of the data received in said step (c).

### Claim 5 (depends on 1)

A method as recited in claim 1, further comprising the step (d) of rendering a computer-generated image of the moving object based on graphics data for the moving object and a position of the object indicated by data adjusted in said step (b).

### Claim 6 (depends on 1)

A method as recited in claim 1, further comprising, prior to said steps (a) and (b), the steps of:
(e) obtaining a first estimate of the data indicating a position of the moving object by measuring a position of the moving object;
(f) obtaining a first prediction of the precision of the first estimate;
(g) obtaining a second estimate of the data indicating a position of the moving object by extrapolating a position of the moving object based on one or more prior positions of the object
(h) obtaining a second prediction of the precision of the second estimate; and
(i) obtaining the data indicating a position of the object used in said step (a) based at least on the first and second estimates and the first and second predictions.

### Claim 7

A method of correcting data generated during a live event, the data indicating a position of a first object in the event, the method comprising the steps of:
(a) determining whether the data indicates the first object occupies at least partially the same space as another object from the event; and
(b) adjusting the data for at least the first object to move the first object out of the same space occupied by the other object in the event if it is determined in said step (a) that the data indicates the first object at least partially occupies the same space as the other object.

### Claim 8 (depends on 7)

A method as recited in claim 7, wherein the event is an automobile race and the first object is a car.

### Claim 9 (depends on 8)

A method as recited in claim 8, wherein said step (b) comprises the step of adjusting the data of the first car to move the first car transversely across the race track away from the other object.

### Claim 10 (depends on 8)

A method as recited in claim 8, wherein said step (b) comprises the step of adjusting the data of the first car to move the first car longitudinally along the race track away from the other object.

### Claim 11 (depends on 8)

A method as recited in claim 8, wherein the other object is a second car, said step (b) comprises the step of adjusting the data of the first car to move the first car away from the second car without changing an order of the first and second cars in the race.

### Claim 12 (depends on 8)

A method as recited in claim 8, wherein the other object comprises a wall, said step (b) comprises the step of adjusting the data of the first car to move the first car away from the wall.

### Claim 13 (depends on 8)

A method as recited in claim 8, wherein the other object comprises a second car, the method further comprising the steps of:
(c) generating data relating to the positions of the first and second objects prior to said step (a);
(d) generating predictions as to the precision of the data generated in said step (c) for the first and second cars.

### Claim 14 (depends on 13)

A method as recited in claim 13, wherein said step (b) comprises adjusting the data relating to the position of the first and second cars to move each car a distance based on the predictions generated in said step (d).

### Claim 15 (depends on 13)

A method as recited in claim 13, wherein said step (b) comprises adjusting the data relating to the position of the first and second cars to move each car a distance proportional to a ratio of the predictions generated in said step (d).

### Claim 16 (depends on 13)

A method as recited in claim 13, wherein said step (a) comprises the step of receiving GPS measurements of the position of the first and second cars.

### Claim 17 (depends on 13)

A method as recited in claim 13, wherein said step (a) comprises the step of receiving measurements from at least one of the Galileo positioning system, the GLONASS positioning system, a ground-based RF system, an optical tracking position determination system and a track modeling system.

### Claim 18 (depends on 13)

A method as recited in claim 13, wherein said step (a) comprises the step of receiving measurements from at least one of an optical tracking system and a ground-based RF position determination system.

### Claim 19 (depends on 13)

A method as recited in claim 13, wherein said step (a) comprises the step of receiving an indication of the movement of the first and second cars from inertia measurement units within the first and second cars.

### Claim 20

A method of filtering data taken from an event, the data indicating a position of a moving object, the method comprising the steps of:
(a) obtaining a first estimate of the data indicating a position of the moving object by measuring a position of the moving object;
(b) obtaining a first prediction of the precision of the first estimate;
(c) obtaining a second estimate of the data indicating a position of the moving object by extrapolating a position of the moving object based on one or more prior positions of the object;
(d) obtaining a second prediction of the precision of the second estimate;
(e) obtaining a third estimate of the data indicating a position of the moving object using historical data indicating a reference line representing an estimate of a path traveled by object at an earlier time;
(f) obtaining a third prediction of the precision of the third estimate; and
(g) obtaining a fourth estimate of the data indicating a position of the object based on the first, second and third estimates and the first, second and third predictions.

### Claim 21 (depends on 20)

A method as recited in claim 20, said step (g) comprising obtaining the fourth estimate using a least squares estimation filter.

### Claim 22 (depends on 20)

A method as recited in claim 20, said step (g) comprising obtaining the fourth estimate using a Kalman filter.

### Claim 23 (depends on 20)

A method as recited in claim 20, wherein said step (a) comprises the step of receiving measurements from at least one of GPS, the Galileo positioning system, the GLONASS positioning system, a ground-based RF system, an optical tracking position determination system and a track modeling system.

### Claim 24 (depends on 20)

A method as recited in claim 20, wherein said step (a) comprises the step of receiving an indication of the movement of the moving object from inertia measurement units within the first and second cars.

### Claim 25

A method of rendering a three-dimensional computer-generated image of a live event on a client device, the event including at least a first and a second object, the method comprising the steps of:
(a) generating data relating to the positions of the first and second objects at a given time;
(b) generating predictions as to the precision of the data generated in said step (a) for the first and second objects at the given time;
(c) generating a first update of the data relating to positions of the first and second moving objects at the given time using a state estimation process; and
(d) generating a second update of the data relating to positions of the first and second moving objects at the given time using an overlap correction process.

### Claim 26 (depends on 25)

A method as recited in claim 25, further comprising the step of repeating steps (a) through (d) for subsequent time periods, and streaming the data for each given time generated by the second update of the data in step (d) to the client device.

### Claim 27 (depends on 26)

A method as recited in claim 26, further comprising the step of sending graphics data relating to the appearance of the first and second moving objects to the client device.

### Claim 28 (depends on 27)

A method as recited in claim 27, further comprising the step of rendering at least one of the first and second moving objects on a display associated with the client device based on: i) the graphics data relating to the appearance of the first and second moving objects to the client device, and ii) data streamed to the client device relating to positions of the first and second moving objects generated in the second update of the data in said step (d).

### Claim 29 (depends on 28)

A method as recited in claim 28, wherein said step of rendering at least one of the first and second moving objects renders at least one of the first and second objects in a position representing a substantially real time position of the first or second objects.

### Claim 30 (depends on 28)

A method as recited in claim 28, further comprising the step of providing computer code allowing playback or pause of the rendering of at least one of the first and second moving objects using streaming data buffered in memory of the client device.

### Claim 31 (depends on 27)

A method as recited in claim 27, further comprising the step of providing a computer code to the client device for allowing a user to select a field of view of the event.

### Claim 32 (depends on 31)

A method as recited in claim 31, further comprising the step of rendering at least one of the first and second moving objects on a display associated with the client device based on: i) the graphics data relating to the appearance of the first and second moving objects to the client device, ii) data streamed to the client device relating to positions of the first and second moving objects generated in the second update of the data in said step (d), and iii) a field of view selected by the user.

### Claim 33 (depends on 25)

A method as recited in claim 25, wherein the event is an automobile race and the first and second objects are first and second cars, respectively.

### Claim 34 (depends on 33)

A method as recited in claim 33, wherein said step (a) comprises the step of receiving measurements from at least one of GPS, the Galileo positioning system, the GLONASS positioning system, a ground-based RF system, an optical tracking position determination system and a track modeling system.

### Claim 35 (depends on 33)

A method as recited in claim 33, wherein said step (a) comprises the step of receiving an indication of the movement of the moving object from inertia measurement units within the first and second cars.

### Claim 36 (depends on 33)

A method as recited in claim 33, wherein said step (c) comprises the use of a least squares estimation filter.

### Claim 37 (depends on 33)

A method as recited in claim 33, wherein said step (c) comprises the use of a Kalman filter.

### Claim 38 (depends on 33)

A method as recited in claim 33, wherein said step (d) comprises the steps of:
(d1) determining whether the data indicates the first car occupies at least partially the same space as another object from the event; and
(d2) adjusting the data for at least the first car to move the first car out of the same space occupied by the other object in the event it is determined in said step (a) that the data indicates the first car at least partially occupies the same space as the other object.

### Claim 39 (depends on 37)

A method as recited in claim 37, wherein said step (d2) comprises the step of adjusting the data of the first car to move the first car transversely across the race track away from the other object.

### Claim 40 (depends on 37)

A method as recited in claim 37, wherein said step (d2) comprises the step of adjusting the data of the first car to move the first car longitudinally along the race track away from the second car.

### Claim 41 (depends on 37)

A method as recited in claim 37, wherein said step (b) comprises the step of adjusting the data of the first car to move the first car away from the second car without changing an order of the first and second cars in the race.

### Claim 42

A method of rendering a three-dimensional computer-generated image of a live event on a client device, the event including moving objects, the method comprising the steps of:
(a) providing a computer code allowing a user to specify a target for use in defining a field of view of the image; and
(b) providing a computer code allowing a user to specify an eye for use in defining the field of view of the image;
(c) distributing data relating to positions of the moving objects in the live event; and
(d) providing a computer code rendering the computer-generated image of the live event on a display of the client device, using at least the target specified by the user in said step (a), the eye specified by the user in said step (b), and the data relating to positions of the moving objects distributed in said step (c).

### Claim 43 (depends on 42)

A method as recited in claim 42, further comprising the step of providing a computer code allowing a user to specify an orientation of the live event rendered on the display of the client device.
