# US 2021/0279945 A1 · Method and device for processing content

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0279945 A1
- Document ID: US20210279945A1
- Status: Published application
- Kind: A1
- Application number: 17/256,505
- Filed: 2019-07-09
- Published: 2021-09-09
- Earliest claimed: 2018-07-10
- Assignees: Samsung Electronics Co., Ltd.
- Applicants: Samsung Electronics Co., Ltd.
- Inventors: Jaehyeon BAE; Youngwan SO; Hyunkoo YANG; Eric YIP
- Web page: https://patentgrep.com/patent/US20210279945A1

## CPC

- G06T 15/20: Perspective computation
- H04N 21/44012: {involving rendering scenes according to scene graphs, e.g. MPEG-4 scene graphs}
- G06F 3/0346: with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
- G06T 11/00: Two-dimensional [2D] image generation
- H04N 21/218: Source of audio or video content {, e.g. local disk arrays (details of retrieval in video databases G06F16/739)}
- H04N 21/23412: {for generating or manipulating the scene composition of objects, e.g. MPEG-4 objects}
- H04N 21/234363: {by altering the spatial resolution, e.g. for clients with a lower screen resolution}
- H04N 21/23439: {for generating different versions}
- H04N 21/2662: Controlling the complexity of the video stream, e.g. by scaling the resolution or bitrate of the video stream based on the client capabilities
- H04N 21/431: Generation of visual interfaces {for content selection or interaction}; Content or additional data rendering
- H04N 21/434: Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream {(demultiplexing of data packets for data networks, e.g. RTP/UDP H04L65/00)}
- H04N 21/4508: {Management of client data or end-user data}
- H04N 21/6587: Control parameters, e.g. trick play commands, viewpoint selection
- H04N 21/81: Monomedia components thereof
- H04N 21/816: {involving special video data, e.g 3D video}
- G06T 2200/16: involving adaptation to the client's capabilities
- G06T 2210/36: Level of detail
- H04N 21/47205: {for manipulating displayed content, e.g. interacting with MPEG-4 objects, editing locally}
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

According to an embodiment of the present disclosure, there is provided a method of receiving a multimedia service, in which, by using user feedback information in a large-volume 6 degrees of freedom (6DoF) media transmission service using network-based media processing (NBMP), it is possible to reduce network traffic through efficient media transmission and a burden of rendering media content on a terminal. According to an embodiment of the present disclosure, a method of processing content includes receiving content regarding an object in a three-dimensional (3D) space, the content including media data and metadata, performing pre-rendering on the media data based on user information, and outputting pre-rendered data.

## Claims

### Claim 1

A method of processing content, the method comprising:
receiving content regarding an object in a three-dimensional (3D) space, the content comprising media data and metadata;
performing pre-rendering on the media data based on user information; and
outputting the pre-rendered data.

### Claim 2 (depends on 1)

The method of claim 1,
wherein the content is 6 degrees of freedom (6DoF) content, and
wherein the method is implemented based on network-based media processing (NBMP).

### Claim 3 (depends on 1)

The method of claim 1, wherein the performing of the pre-rendering comprises:
performing geometric processing for expressing the object in a virtual space with respect to the media data, based on the metadata; and
providing two-dimensional (2D) content or partial 3D content by performing rendering on data resulting from the geometric processing, based on the user information.

### Claim 4 (depends on 1)

The method of claim 1, wherein the performing of the pre-rendering comprises providing 2D content or partial 3D content corresponding to a user's view by performing rendering on the media data.

### Claim 5 (depends on 1)

The method of claim 1, further comprising:
receiving the user information from a user terminal, wherein the user information comprises at least one of user location information, user view information, network environment information, or state information of the user terminal.

### Claim 6 (depends on 1)

The method of claim 1, wherein the performing of the pre-rendering comprises performing rendering on the media data according to a level of detail (LoD) of the object, determined based on a user location.

### Claim 7 (depends on 1)

The method of claim 1, wherein the performing of the pre-rendering comprises:
generating a plurality of streams having different LoDs for the object, based on the media data; and
re-generating content to include at least one of the plurality of streams, based on a user location.

### Claim 8 (depends on 1)

The method of claim 1, wherein the performing of the pre-rendering comprises performing rendering on the media data based on a user location, such that a resolution of the object decreases as a distance between the user and the object increases.

### Claim 9

A device for processing content, which processes the content and transmits the processed content to a device, comprising:
at least one processor, wherein the at least one processor is configured to:
receive content regarding an object in a three-dimensional (3D) space, the content comprising media data and metadata,
perform pre-rendering on the media data based on user information, and
output the pre-rendered data.

### Claim 10 (depends on 9)

The device of claim 9,
wherein the content is 6 degrees of freedom (6DoF) content, and
wherein the device uses network-based media processing (NBMP).

### Claim 11 (depends on 9)

The device of claim 9, wherein the at least one processor is configured to:
perform geometric processing for expressing the object in a virtual space with respect to the media data, based on the metadata; and
provide two-dimensional (2D) content or partial 3D content by performing rendering on data resulting from the geometric processing, based on the user information.

### Claim 12 (depends on 9)

The device of claim 9, wherein the at least one processor is configured to provide 2D content or partial 3D content corresponding to a user's view by performing rendering on the media data.

### Claim 13 (depends on 9)

The device of claim 9,
wherein the at least one processor is configured to receive the user information from the device, and
wherein the user information comprises at least one of user location information, user view information, network environment information, or state information of a user terminal.

### Claim 14 (depends on 9)

The device of claim 9, wherein the at least one processor is configured to perform rendering on the media data according to a level of detail (LoD) of the object, determined based on a user location.

### Claim 15 (depends on 9)

The device of claim 9, wherein the at least one processor is configured to:
generate a plurality of streams having different LoDs for the object, based on the media data, and
re-generate content to include at least one of the plurality of streams, based on a user location.

### Claim 16 (depends on 9)

The device of claim 9, wherein the at least one processor is configured to perform rendering on the media data based on a user location, such that a resolution of the object decreases as a distance between the user and the object increases.
