Method and apparatus for view-dependent tone mapping of virtual reality images
AssigneeSamsung Electronics Co., Ltd.
InventorsHossein Najaf-Zadeh, Madhukar Budagavi, Ankur Saxena
Life of this patent
Estimating the term…
Abstract
A user equipment (UE) includes a receiver, at least one sensor, and a processor. The receiver is configured to receive a bit stream including at least one encoded image and metadata. The sensor is configured to determine viewpoint information of a user. The processor is configured to render the at least one encoded image based on the metadata and the viewpoint.
Claims18
A user equipment (UE), comprising:
- at least one orientation sensor configured to determine viewpoint information of a user;
- and
- a computer processor configured to:
- receive a bit stream including at least one encoded image and metadata,
- decode the bit stream into a decoded image and the metadata, the decoded image segmented into multiple segments indicated by the metadata,
- determine a portion of the decoded image corresponding to a viewport indicated by the viewpoint information,
- identify segments, of the multiple segments, that are included in the viewport,
- derive a tone mapping function for the viewport that is associated with the segments that are included in the viewport, the tone mapping function based on the metadata corresponding to the segments,
- identify a weighted average of peak luminance based on portions of the segments that are included in the viewport,
- apply the tone mapping function based on the weighted average of the peak luminance to the portion of the decoded image that corresponds to the viewport, and
- render the portion of the decoded image.
A method for rendering media in user equipment (UE), the method comprising:
- receiving a bit stream including at least one encoded image and metadata;
- decoding the bit stream into a decoded image and the metadata, the decoded segmented into multiple segments indicated by the metadata;
- determining a viewport based on an orientation of the UE;
- determining a portion of the decoded image corresponding to the viewport;
- identify segments, of the multiple segments, that are included in the viewport;
- deriving a tone mapping function for the viewport that is associated with the segments that are included in the viewport, the tone mapping function based on the metadata corresponding to segments;
- identifying a weighted average of peak luminance based on portions of the segments that are included in the viewport;
- applying the tone mapping function based on the weighted average of the peak luminance to the decoded image that corresponds to the viewport;
- and
- rendering the portion of the decoded image.
A non-transitory computer readable medium embodying a computer program, the computer program comprising computer readable program code that when executed causes at least one processing device to:
- receive a bit stream including at least one encoded image and metadata;
- decode the bit stream into a decoded image and the metadata, the decoded image segmented into multiple segments indicated by the metadata;
- determine a viewport based on an orientation of a user equipment (UE);
- determine a portion of the decoded image corresponding to the viewport;
- identify segments, of the multiple segments, that are included in the viewport;
- derive a tone mapping function for the viewport that is associated with the segments that are included in the viewport, the tone mapping function based on the metadata corresponding to the segments;
- identify a weighted average of peak luminance based on portions of the segments that are included in the viewport;
- applying the tone mapping function based on the weighted average of the peak luminance to the decoded image that corresponds to the viewport;
- and
- render the portion of the decoded image.
Dependencies are inferred from the claim text.