# US 12,120,385 B2 · Method, apparatus, and program product for authoring video content using stream embedded indicators

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,120,385 B2
- Document ID: US12120385B2
- Status: Granted
- Kind: B2
- Application number: 17/709,843
- Filed: 2022-03-31
- Published: 2023-10-05
- Granted: 2024-10-15
- Earliest claimed: 2022-03-31
- Assignees: Lenovo (Singapore) Pte. Ltd.
- Applicants: Lenovo (Singapore) Pte. Ltd.
- Inventors: Robert J. Kapinos; Scott Li; Robert James Norton, Jr.; Russell Speight VanBlon
- Web page: https://patentgrep.com/patent/US12120385B2

## CPC

- H04N 21/4402: involving reformatting operations of video signals for household redistribution, storage or real-time display {(details of conversion of video standards at pixel level H04N7/01; video transcoding H04N19/40; adapting incoming signals to the display format of the display terminal G09G5/005; media handling at the source in data packet switching networks H04L65/764)}
- H04N 21/440245: {the reformatting operation being performed only on part of the stream, e.g. a region of the image or a time segment}
- H04N 21/44008: {involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream (arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59)}
- H04N 21/816: {involving special video data, e.g 3D video}
- H04N 21/4318: {by altering the content in the rendering process, e.g. blanking, blurring or masking an image region (image enhancement or restoration in general G06T5/00)}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Apparatuses, methods, and program products are disclosed for displaying video inputs. One apparatus includes a display, a processor, and a memory that stores code executable by the processor. The code is executable by the processor to receive, by use of the processor, multiple video inputs. The code is executable by the processor to determine display criteria of each video input of the multiple video inputs based on user selection. The code is executable by the processor to display, by use of the display, each video input of the multiple video inputs based on the display criteria of the respective video input.

## Claims

### Claim 1

A method comprising:
receiving a video source stream captured by a video handling device;
authoring a video segment of the received video source stream, the video segment having a first stream associated with a first electro-optical transfer function with at least one portion correctly authored for a lower quality display and at least one portion incorrectly authored relative to a first electro-optical transfer function for a lower quality display;
displaying a single frame of the video segment comprising the at least one portion correctly authored and the at least one portion incorrectly authored, wherein the at least one portion incorrectly authored produces undesired visual artifacts due to an inadequate luminosity or chromacity range;
embedding at least one indicator into the at least one portion incorrectly authored within a frame of the video segment, wherein the indicator notifies a viewer that the at least one portion incorrectly authored is not playing at its full bit depth in accordance with the video source stream; and
enhancing the first stream by adding a bit pattern of a second stream to produce an enhanced stream, wherein the enhanced stream is associated with a second electro-optical transfer function having a higher quality than the first electro-optical transfer function, wherein the second stream includes compensating data for correcting errors associated with the first stream.

### Claim 2 (depends on 1)

The method of claim 1 further comprising:
rendering the enhanced video segment first stream on a higher quality display to produce a rendered enhanced first stream.

### Claim 3 (depends on 2)

The method of claim 2, wherein correcting the at least one portion incorrectly authored for a lower quality display comprises covering the at least one embedded indicator so that the embedded indicator is not visible in the rendered enhanced first stream.

### Claim 4 (depends on 2)

The method of claim 2, wherein enhancing the first stream with a second stream authored for a higher quality display comprises correcting multiple portions incorrectly authored for a lower quality display and wherein correcting multiple portions incorrectly authored for a lower quality display comprises covering multiple embedded indicators so that the embedded indicators are not visible in the rendered enhanced video segment.

### Claim 5 (depends on 2)

The method of claim 2, wherein enhancing the first stream with a second stream authored for a higher quality display enhances all portions of the first stream.

### Claim 6 (depends on 2)

The method of claim 2, wherein the lower quality display is selected from the group of consisting of 8-bit and SDR formats.

### Claim 7 (depends on 2)

The method of claim 2, wherein the format of the second stream authored for a higher quality display is selected from the group consisting of high dynamic range, wide color gamut, Dolby Vision HDR, HDR10, HDR10+, HDR10 Pro, and HDR HLG formats.

### Claim 8 (depends on 2)

The method of claim 2, wherein the lower quality display is configured to display at least a 10-bit video format.

### Claim 9 (depends on 8)

The method of claim 8, wherein the second stream authored for a higher quality display is formatted in at least a 12-bit video format.

### Claim 10 (depends on 2)

The method of claim 2, wherein the video segment comprises computer-generated three-dimensional (“3D”) content.

### Claim 11 (depends on 2)

The method of claim 2, wherein the higher quality display is selected from a group consisting of a desktop computer, a laptop computer, a personal digital assistant, a tablet computer, a smart phone, a smart television, a monitor, a projector, a set-top box, a game console, a virtual reality headset, a security system, a vehicle on-board computer, and a streaming device.

### Claim 12

An apparatus comprising:
a video handling device configured to generate a video source stream;
a video authoring module configured to author a video segment of the received video source stream, the video segment having a first stream associated with a first electro-optical transfer function with at least one portion correctly authored for a lower quality display and at least one portion incorrectly authored relative to the first electro-optical transfer function for a lower quality display, wherein the at least one portion incorrectly authored produces undesired visual artifacts due to an inadequate luminosity or chromacity range; and
a video processor configured to:
display a single frame of the video segment comprising the at least one portion correctly authored and the at least one portion incorrectly authored;
embed an indicator into the at least one portion incorrectly authored within a frame of the video segment, wherein the indicator notifies a viewer that the at least one portion incorrectly authored is not playing at its full bit depth in accordance with the video source stream; and
enhance the first stream by adding a bit pattern of a second stream to produce an enhanced stream, wherein the enhanced stream is associated with a second electro-optical transfer function having a higher quality than the first electro-optical transfer function, wherein the second stream includes compensating data for correcting errors associated with the first stream.

### Claim 13 (depends on 12)

The apparatus of claim 12, wherein the video processor is further configured to correct the at least one portion incorrectly authored for a lower quality display.

### Claim 14 (depends on 12)

The apparatus of claim 12, further comprising a video renderer for rendering the enhanced video segment on a higher quality display, wherein the video processor is configured to cover the at least one embedded indicator so that the embedded indicator is not visible in the rendered enhanced video segment.

### Claim 15 (depends on 12)

The apparatus of claim 12, wherein the video processor is configured to correct multiple portions incorrectly authored for a lower quality display and configured to cover multiple embedded indicators so that the multiple embedded indicators are not visible in the rendered enhanced video segment.

### Claim 16 (depends on 12)

The apparatus of claim 12, wherein the video processor is further configured to show a pre-render view of the enhanced video segment.

### Claim 17 (depends on 13)

The apparatus of claim 13, wherein the video processor is configured to enhance all portions of the first stream.

### Claim 18 (depends on 12)

The apparatus of claim 12, wherein the video segment comprises computer-generated three-dimensional (“3D”) content.

### Claim 19 (depends on 12)

The apparatus of claim 12, further comprising a user interface to allow customization of the indicator.

### Claim 20

A computer program product for enhancing video, the computer program product comprising a non-transitory computer readable storage medium having program instructions embodied therewith, the program instructions executable by a processor to cause the processor to:
receive a video source stream captured by a video handling device;
assist a user with authoring a video segment of the received video source stream, the video segment having a first stream associated with a first electro-optical transfer function with at least one portion correctly authored for a lower quality display and at least one portion incorrectly authored relative to the first electro-optical transfer function for a lower quality display, wherein the at least one portion incorrectly authored produces undesired visual artifacts due to an inadequate luminosity or chromacity range;
display a single frame of the video segment comprising the at least one portion correctly authored and the at least one portion incorrectly authored;
embed an indicator into the first stream within a frame of the video segment, wherein the indicator notifies a viewer that the at least one portion incorrectly authored is not playing at its full bit depth in accordance with the video source stream;
enhance the first stream with a second stream to produce an enhanced stream, wherein the enhanced stream is associated with a second electro-optical transfer function having a higher quality than the first electro-optical transfer function, wherein the second stream includes compensating data for correcting errors associated with the first stream; and
render the enhanced stream.
