# US 10,769,797 B2 · Virtual reality experience sharing > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,769,797 B2 - Document ID: US10769797B2 - Status: Granted - Kind: B2 - Application number: 15/801,174 - Filed: 2017-11-01 - Published: 2018-07-05 - Granted: 2020-09-08 - Earliest claimed: 2017-01-05 - Assignees: Samsung Electronics Co., Ltd. - Applicants: Samsung Electronics Co., Ltd - Inventors: Madhukar Budagavi; Imed Bouazizi; Youngkwon Lim; Andrew Joseph Dickerson - Web page: https://patentgrep.com/patent/US10769797B2 ## CPC - G06T 7/20: Analysis of motion (motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51) - G06F 1/1626: {with a single-body enclosure integrating a flat display, e.g. Personal Digital Assistants [PDAs]} - G06F 1/163: {Wearable computers, e.g. on a belt} - G06F 1/1694: {the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer} - G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)} - G06F 3/012: {Head tracking input arrangements} - G06T 19/003: {Navigation within 3D models or images} - H04N 21/2353: {specifically adapted to content descriptors, e.g. coding, compressing or processing of metadata} - H04N 21/42222: {Additional components integrated in the remote control device, e.g. timer, speaker, sensors for detecting position, direction or movement of the remote control, microphone or battery charging device} - H04N 21/4788: communicating with other users, e.g. chatting {(arrangements for providing for computer conferences, e.g. chat rooms, to substation in data switching networks H04L12/1813; distributed application using peer-to-peer [P2P] networks H04L67/104)} - H04N 21/6587: Control parameters, e.g. trick play commands, viewpoint selection - H04N 21/816: {involving special video data, e.g 3D video} - H04N 21/84: Generation or processing of descriptive data, e.g. content descriptors {(systems specially adapted for using meta-information in broadcast systems H04H60/73)} - H04N 21/8543: using a description language, e.g. Multimedia and Hypermedia information coding Expert Group [MHEG], eXtensible Markup Language [XML] {(information retrieval of semistructured data, the underlying structure being taken into account, e.g. mark-up language structure data G06F16/80)} - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract A UE includes a communication unit, a display, at least one sensor, and a processor. The communication unit receives video from a server and the display renders a portion of the video. The sensor determines a pitch and a yaw of the portion of the video and a processor generates metadata that includes the pitch and the yaw. ## Claims ### Claim 1 A user equipment (UE) comprising: a communication unit configured to receive a video from a server; a display configured to render a portion of the video including a region of interest (ROI); at least one sensor configured to determine a pitch and a yaw of the portion of the video; and a processor configured to generate metadata, the metadata including a flag that represents a value, the pitch, and the yaw, wherein when the value of the flag is a first value, the flag indicates that a frame of the video uses a first set of coordinates for the ROI from a previous frame and when the value of the flag is a second value, the flag indicates that a frame of the video uses a second set of coordinates for the ROI that are interpolated from an anchor frame. ### Claim 2 (depends on 1) The UE of claim 1, wherein the metadata further includes a frame identification that associates the frame to the pitch and the yaw. ### Claim 3 (depends on 2) The UE of claim 2, wherein the metadata further includes a user ID that identifies a user of the UE. ### Claim 4 (depends on 3) The UE of claim 3, wherein the communication unit is configured to transmit the metadata to the server. ### Claim 5 (depends on 1) The UE of claim 1, wherein the communication unit is configured to receive additional metadata including a second pitch and a second yaw generated by another UE, and the display is configured to render another portion of the video according to the second pitch and the second yaw. ### Claim 6 (depends on 1) The UE of claim 1, wherein the metadata further includes a second flag configured to indicate whether a size of the ROI is fixed or dynamic. ### Claim 7 (depends on 6) The UE of claim 6, wherein when the second flag indicates the size of the ROI is dynamic, the metadata further indicates a width and a height of the ROI in the portion of the video. ### Claim 8 (depends on 6) The UE of claim 6, wherein when the second flag indicates the ROI is fixed the metadata does not include a width and a height of the ROI in the portion of the video. ### Claim 9 (depends on 1) The UE of claim 1, further comprising an input button configured to retrieve the pitch and the yaw from the at least one sensor when the input button is actuated. ### Claim 10 A user equipment (UE) comprising: a communication unit configured to receive a video from a server; a display configured to display a graphical user interface (GUI), the GUI including a rendering of a portion of the video including a region of interest (ROI); and a processor configured to: determine a pitch and a yaw when the ROI is selected by a user; and generate metadata, the metadata including a flag that represents a value, the pitch, and the yaw, wherein when the value of the flag is a first value, the flag indicates that a frame of the video uses a first set of coordinates for the ROI from a previous frame and when the value of the flag is a second value, the flag indicates that a frame of the video uses a second set of coordinates for the ROI that are interpolated from an anchor frame. ### Claim 11 (depends on 10) The UE of claim 10, wherein the metadata further includes a frame identification that associates the frame to the pitch and the yaw. ### Claim 12 (depends on 11) The UE of claim 11, wherein the metadata further includes a user ID that identifies the user of the UE. ### Claim 13 (depends on 12) The UE of claim 12, wherein the communication unit is configured to transmit the metadata to the server. ### Claim 14 (depends on 10) The UE of claim 10, wherein: the GUI is configured to display at least one ROI corresponding to another user; the communication unit is configured to receive additional metadata including a second pitch and a second yaw generated by another UE when the at least one ROI is selected; and the display is configured to render another portion of the video according to the second pitch and the second yaw. ### Claim 15 (depends on 10) The UE of claim 10, wherein the metadata further includes a second flag configured to indicate whether a size of the ROI is fixed or a dynamic. ### Claim 16 (depends on 15) The UE of claim 15, wherein when the second flag indicates the size of the ROI is dynamic, the metadata further indicates a width and a height of the ROI in the portion of the video. ### Claim 17 (depends on 15) The UE of claim 15, wherein when the second flag indicates the ROI is fixed the metadata does not include a width and a height of the ROI in the portion of the video. ### Claim 18 A method for sharing a portion of a video, the method comprising: receiving the video from a server; rendering the portion of the video including a region of interest (ROI); determining a pitch and a yaw of the portion of the video; and generating metadata, the metadata including a flag that represents a value, the pitch, and the yaw, wherein when the value of the flag is a first value, the flag indicates that a frame of the video uses a first set of coordinates for the ROI from a previous frame and when the value of the flag is a second value, the flag indicates that a frame of the video uses a second set of coordinates for the ROI that are interpolated from an anchor frame. ### Claim 19 (depends on 18) The method of claim 18, wherein the metadata further includes a frame identification that associates the frame to the pitch and the yaw. ### Claim 20 (depends on 19) The method of claim 19, further comprising transmitting the metadata to the server.