# US 2013/0293537 A1 · Coordinated 2-Dimensional and 3-Dimensional Graphics Processing

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2013/0293537 A1
- Document ID: US20130293537A1
- Status: Published application
- Kind: A1
- Application number: 13/978,332
- Filed: 2011-10-03
- Published: 2013-11-07
- Earliest claimed: 2011-01-05
- Assignees: Cisco Technology, Inc.
- Inventors: Nicolas Gaude; Alex Ruelle; Mohamed Yahyaoul; Fabien Andrieux; Julien Marichez; Fabien Lengronne
- Web page: https://patentgrep.com/patent/US20130293537A1

## CPC

- G06T 13/20: Three-dimensional [3D] animation
- A63F 13/52: involving aspects of the displayed game scene
- G06T 13/00: Animation
- G06T 13/40: of characters, e.g. humans, animals or virtual beings
- G06T 13/80: Two-dimensional [2D] animation, e.g. using sprites
- G06T 15/00: Three-dimensional [3D] image rendering
- G06T 15/10: Geometric effects
- G06T 17/00: Three-dimensional [3D] modelling for computer graphics
- G06T 17/20: Finite element generation, e.g. wire-frame surface description, {tesselation}
- G06T 19/00: Manipulating three-dimensional [3D] models or images for computer graphics
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- A63F: CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR

## Abstract

A data processing system (70) for graphics processing, including a scene manager (80). The scene manager (80) includes a scene loader (86) for receiving a description of 3 dimensional objects in a scene from a 3-dimensional modelling tool (46). The description includes first 2-dimensional frame data. The scene manager (80) has a texture image modification unit (84) for receiving second 2-dimensional frame data from a 2-dimensional rendering engine (40), and for replacing the first frame data by the second frame data. The scene manager (80) has an animation scheduler for scheduling and monitoring an animation of the scene. The system includes a display manager (96) operative to invoke the scene manager (80) to render output frames in a display buffer (100), and a scene Tenderer (88) configured for applying the 2-dimensional frame data to the 3-dimensional objects to produce textured 3-dimensional objects in the display buffer (100) and outputting the textured objects in the animation. Related apparatus and methods are also described.

## Claims

### Claim 1

A data processing system for graphics processing, comprising:
a scene manager, comprising:
a scene loader operative to receive a scene description obtained after processing a design in a 3-dimensional authoring tool, the scene description comprising: a description of 3 dimensional objects in the scene, first 2-dimensional frame data for the 3-dimensional objects; and guidance information for replacing the first 2-dimensional frame data;
a texture image modification unit, operative to receive second 2-dimensional frame data rendered in a 2-dimensional frame buffer by a 2-dimensional rendering engine, the second 2-dimensional frame data being obtained after processing a design in a 2-dimensional authoring tool, and to replace the first 2-dimensional frame data by the second 2-dimensional frame data by associating coordinates of the second 2-dimensional frame data in the frame buffer to the 3-dimensional objects according to the guidance information; and
an animation scheduler operative to schedule and monitor an animation of the scene;
a display manager operative to invoke the scene manager to render output frames in a display buffer at a selected frequency of operation; and
a scene renderer configured for automatically applying the second 2-dimensional frame data to the 3-dimensional objects to produce textured 3-dimensional objects in the display buffer and outputting the textured 3-dimensional objects in the animation.

### Claim 2 (depends on 1)

The system according to claim 1, further comprising:
a video decoder; and
a video frame buffer, receiving output from the video decoder, wherein at least a portion of the second 2-dimensional frame data is provided to the texture image modification unit from the video frame buffer.

### Claim 3 (depends on 1)

The system according to claim 1, further comprising a binding controller, receiving control signals from an executing computer application via an interface to the computer application, the binding controller recognizing events occurring during operation of the animation scheduler and operative to issue instructions to the scene loader and the animation scheduler responsively to the control signals and the events.

### Claim 4 (depends on 3)

The system according to claim 3, wherein the control signals of the computer application comprise at least one of a first instruction to direct loading of the scene by the scene loader and a second instruction to initiate, discontinue or regulate operation of the animation.

### Claim 5 (depends on 1)

The system according to claim 1, wherein the scene manager is operative to define generic graphic areas in a rendering buffer and to iterate a 3-dimensional animation by storing new 2-dimensional frame data in the generic graphic areas, and accessing the new 2-dimensional frame data in respective iterations of the 3-dimensional animation.

### Claim 6 (depends on 5)

The system according to claim 5, wherein the accessing of the new 2-dimensional frame data comprises the steps of:
while performing a new iteration of the 3-dimensional animation:
locking the scene renderer;
thereafter updating the rendering buffer;
after completing the step of updating the rendering buffer unlocking the scene renderer; and
rendering the 3-dimensional animation.

### Claim 7

A device for graphics processing, comprising:
a receiver for first image data of a scene comprising a video stream;
a storage unit holding 2 dimensional frame data comprising the first image data and further comprising second image data output from a 2-dimensional rendering engine, the second image data being obtained after processing a design in a 2-dimensional authoring tool, the storage unit further operative to memorize a scene description being obtained after processing the design in a 3-dimensional authoring tool, the scene description comprising: a description of 3 dimensional objects in the scene; first 2-dimensional frame data for the 3-dimensional objects; and guidance information for replacing the first 2-dimensional frame data;
a scene manager, comprising:
a scene loader operative to access the scene description from the storage unit;
a texture image modification unit, operative to receive second 2-dimensional frame data from the storage unit, and to replace the first 2-dimensional frame data by the second 2-dimensional frame data by associating coordinates of the second 2-dimensional frame data in the storage unit to the 3-dimensional objects according to the guidance information;
an animation scheduler operative to schedule and monitor an animation of the scene;
a display manager operative to invoke the scene manager to render output frame in a display buffer at a selected frequency of operation; and
a scene renderer configured for automatically applying the second 2-dimensional frame data to the 3-dimensional objects to produce textured 3-dimensional objects and outputting the textured 3-dimensional objects in the animation.

### Claim 8 (depends on 7)

The device according to claim 7, wherein further comprising a display accepting output of the scene renderer, and wherein the receiver, the storage unit, the scene manager and the display manager are disposed in a common housing as a set-top box adapted to the display.

### Claim 9 (depends on 7)

The device according to claim 7, further comprising:
a video decoder; and
a video frame buffer, receiving output from the video decoder, wherein at least a portion of the 2 dimensional frame data is provided to the texture image modification unit from the video frame buffer.

### Claim 10 (depends on 7)

The device according to claim 7, further comprising a binding controller, receiving control signals from an executing computer application via an interface to the computer application, the binding controller recognizing events occurring during operation of the animation scheduler and operative to issue instructions to the scene loader and the animation scheduler responsively to the control signals and the events.

### Claim 11 (depends on 10)

The device according to claim 10, wherein the control signals of the computer application comprise at least one of a first instruction to direct loading of the scene by the scene loader, and a second instruction to initiate, discontinue and regulate operation of the animation.

### Claim 12 (depends on 7)

The device according to claim 7, wherein the scene manager is operative to define generic graphic areas in a rendering buffer and to iterate a 3-dimensional animation by storing new 2-dimensional frame data in the generic graphic areas, and accessing the new 2-dimensional frame data in respective iterations of the 3-dimensional animation.

### Claim 13 (depends on 12)

The device according to claim 12, wherein the accessing of the new 2-dimensional frame data comprises the steps of:
while performing a new iteration of the 3-dimensional animation:
locking the scene renderer;
thereafter updating the rendering buffer; and
after completing the step of updating the rendering buffer unlocking the scene renderer; and
rendering the 3-dimensional animation.

### Claim 14

A method of graphics processing, comprising the steps of:
in a first process applying a 2-dimensional authoring tool to a design;
producing first data in a frame buffer from an output of the 2-dimensional authoring tool, the first data comprising 2-dimensional representations of the design;
in a second process applying a 3-dimensional authoring tool to the design to produce second data comprising a scene description of 3-dimensional objects in the design;
synchronizing the first process with the second process;
combining the first data with the second data by employing the first data to generate respective textures of the 3-dimensional objects of the scene description;
generating animations comprising the textures; and
outputting the animations for display thereof.

### Claim 15 (depends on 14)

The method according to claim 14, further comprising producing at least a portion of the first data by decoding a video stream.

### Claim 16 (depends on 14)

The method according to claim 14, further comprising the step of executing a governing computer application to control the steps of synchronizing the first process with the second process and generating animations.

### Claim 17 (depends on 14)

The method according to claim 14, wherein generating animations comprises:
defining generic graphic areas in a rendering buffer;
iterating a 3-dimensional animation by storing new 2-dimensional frame data in the generic graphic areas; and
accessing the new 2-dimensional frame data in respective iterations of the 3-dimensional animation.

### Claim 18 (depends on 17)

The method according to claim 17, wherein the accessing of the new 2-dimensional frame data is performed with a scene renderer and comprises the steps of:
while performing a new iteration of the 3-dimensional animation:
locking the scene renderer;
thereafter updating the rendering buffer;
after completing the step of updating the rendering buffer unlocking the scene renderer; and
rendering the 3-dimensional animation.
