# US 2025/0363733 A1 · Generation apparatus, generation method, reproduction apparatus, and reproduction method

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0363733 A1
- Document ID: US20250363733A1
- Status: Published application
- Kind: A1
- Application number: 18/874,908
- Filed: 2023-05-23
- Published: 2025-11-27
- Earliest claimed: 2022-06-30
- Assignees: Sony Group Corporation
- Applicants: Sony Group Corporation
- Inventors: Toshiya HAMADA
- Web page: https://patentgrep.com/patent/US20250363733A1

## CPC

- G06T 15/04: Texture mapping
- G06T 17/00: Three-dimensional [3D] modelling for computer graphics
- G06F 3/01: Input arrangements or combined input and output arrangements for interaction between user and computer (G06F3/16 takes precedence)
- G06T 15/00: Three-dimensional [3D] image rendering
- G06T 19/00: Manipulating three-dimensional [3D] models or images for computer graphics
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

A generation apparatus according to an embodiment of the present technology includes a generation section. The generation section generates three-dimensional spatial data used in rendering processing executed to represent a three-dimensional space and including sensory representation metadata for representing at least one of a temperature or surface roughness with respect to a component of a scene configured by the three-dimensional space. This makes it possible to greatly simplify the representation of the temperature and the surface roughness in the three-dimensional virtual space, thereby reducing a processing load. As a result, it becomes possible to realize a high-quality virtual video.

## Claims

### Claim 1

A generation apparatus, comprising:
a generation section that generates three-dimensional spatial data used in rendering processing executed to represent a three-dimensional space and including sensory representation metadata for representing at least one of a temperature or surface roughness with respect to a component of a scene configured by the three-dimensional space.

### Claim 2 (depends on 1)

The generation apparatus according to claim 1, wherein
the three-dimensional spatial data includes scene description information that defines a configuration of the three-dimensional space and three-dimensional object data that defines a three-dimensional object in the three-dimensional space, and
the generation section generates at least one of the scene description information including the sensory representation metadata or the three-dimensional object data including the sensory representation metadata.

### Claim 3 (depends on 2)

The generation apparatus according to claim 2, wherein
the generation section generates the scene description information including at least one of a basic temperature or basic surface roughness of the scene configured by the three-dimensional space as the sensory representation metadata.

### Claim 4 (depends on 2)

The generation apparatus according to claim 2, wherein
the three-dimensional object data includes video object data that defines a three-dimensional video object in the three-dimensional space, and
the generation section generates the scene description information including at least one of a basic temperature or basic surface roughness of the three-dimensional video object as the sensory representation metadata.

### Claim 5 (depends on 2)

The generation apparatus according to claim 2, wherein
the three-dimensional object data includes video object data that defines the three-dimensional video object in the three-dimensional space, and
the generation section generates at least one of a temperature texture for representing the temperature or a surface roughness texture for representing the surface roughness as the sensory representation metadata with respect to a surface of the three-dimensional video object.

### Claim 6 (depends on 5)

The generation apparatus according to claim 5, wherein
the video object data includes a normal texture used to visually represent the surface of the three-dimensional video object, and
the generation section generates the surface roughness texture on a basis of the normal texture.

### Claim 7 (depends on 2)

The generation apparatus according to claim 2, wherein
a data format of the scene description information is a glTF (GL Transmission Format).

### Claim 8 (depends on 7)

The generation apparatus according to claim 7, wherein
the three-dimensional object data includes video object data that defines the three-dimensional video object in the three-dimensional space, and
the sensory representation metadata is stored in at least one of an extension area of a node corresponding to the scene configured by the three-dimensional space, an extension area of a node corresponding to the three-dimensional video object, or an extension area of a node corresponding to a surface state of the three-dimensional video object.

### Claim 9 (depends on 8)

The generation apparatus according to claim 8, wherein
in the scene description information, at least one of a basic temperature or basic surface roughness of the scene is stored as the sensory representation metadata in the extension area of the node corresponding to the scene.

### Claim 10 (depends on 8)

The generation apparatus according to claim 8, wherein
in the scene description information, at least one of a basic temperature or basic surface roughness of the three-dimensional video object is stored as the sensory representation metadata in the extension area of the node corresponding to the three-dimensional video object.

### Claim 11 (depends on 8)

The generation apparatus according to claim 8, wherein
in the scene description information, at least one of link information to the temperature texture for representing the temperature or link information to the surface roughness texture for representing the surface roughness is stored as the sensory representation metadata in the extension area of the node corresponding to the surface state of the three-dimensional video object.

### Claim 12

A generation method executed by a computer system, comprising:
generating three-dimensional spatial data that is used in rendering processing executed to represent a three-dimensional space and that includes sensory representation metadata for representing at least one of a temperature or surface roughness with respect to a component of a scene configured by the three-dimensional space.

### Claim 13

A reproduction apparatus, comprising:
a rendering section that generates two-dimensional video data in which a three-dimensional space is represented corresponding to a field of view of a user by executing rendering processing on three-dimensional spatial data on a basis of field of view information about the field of view of the user; and
a representation processing section that represents at least one of a temperature or surface roughness with respect to a component of a scene configured by the three-dimensional space on a basis of the three-dimensional spatial data.

### Claim 14 (depends on 13)

The reproduction apparatus according to claim 13, wherein
the representation processing section represents at least one of the temperature or the surface roughness on a basis of sensory representation metadata included in the three-dimensional spatial data, the sensory representation metadata representing at least one of the temperature or the surface roughness with respect to the component of the scene configured by the three-dimensional space.

### Claim 15 (depends on 13)

The reproduction apparatus according to claim 13, wherein
the representation processing section controls a tactile presentation device used by the user such that at least one of the temperature or the surface roughness of the component is represented.

### Claim 16 (depends on 13)

The reproduction apparatus according to claim 13, wherein
the representation processing section generates a representation image in which at least one of the temperature or the surface roughness of the component is visually represented, and controls the rendering processing by the rendering section to include the representation image.

### Claim 17 (depends on 16)

The reproduction apparatus according to claim 16, wherein
the representation processing section sets a target area in which at least one of the temperature or the surface roughness is represented for the component on a basis of an input from the user, and controls the rendering processing such that the target area is displayed by the representation image.

### Claim 18

A reproduction method executed by a computer system, comprising:
generating two-dimensional video data in which a three-dimensional space is represented corresponding to a field of view of a user by executing rendering processing on three-dimensional spatial data on a basis of field of view information about the field of view of the user; and
representing at least one of a temperature or surface roughness with respect to a component of a scene configured by the three-dimensional space on a basis of the three-dimensional spatial data.
