# US 2023/0055775 A1 · Apparatus and methods for publishing video content

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0055775 A1
- Document ID: US20230055775A1
- Status: Published application
- Kind: A1
- Application number: 17/904,318
- Filed: 2021-02-18
- Published: 2023-02-23
- Earliest claimed: 2020-02-20
- Assignees: Arti D2 Ltd.
- Applicants: Arti D2 Ltd.
- Inventors: Yaron Zakai-Or; Ido Lempert; Dror Belkin; Avner Vilan
- Web page: https://patentgrep.com/patent/US20230055775A1

## CPC

- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- H04N 21/4316: {for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Apparatus and methods for are described for publishing video content, based upon a video feed that is recorded at a first site. In real-time with respect to the recording of the video feed, and using one or more computer processors (23, 24, 27), one or more dispositions are identified within image frames. Data that are indicative of the one or more dispositions within the image frames are communicated to a cloud-based, remote computer server that is remote from the first site. One or more augmented-reality objects (25) are received from the cloud-based, remote computer server, the augmented-reality objects (25) being positioned and oriented to correspond to the positions identified within the image frames belonging to the video feed. The video feed with the augmented-reality objects (25) overlaid upon the image frames is published. Other applications are also described.

## Claims

### Claim 1

A method for publishing video content, based upon a video feed that is recorded at a first site, the method comprising:
in real-time with respect to the recording of the video feed, and using one or more computer processors:
identifying one or more dispositions within image frames belonging to the video feed;
communicating data that are indicative of the one or more dispositions within the image frames belonging to the video feed to a cloud-based, remote computer server that is remote from the first site;
receiving one or more augmented-reality objects from the cloud-based, remote computer server, the augmented-reality objects being positioned and oriented to correspond to the positions identified within the image frames belonging to the video feed; and
publishing the video feed with the augmented-reality objects overlaid upon the image frames.

### Claim 2

(canceled)

### Claim 3 (depends on 1)

The method according to claim 1, wherein the one or more augmented- reality objects include one or more augmented-reality objects selected from the group consisting of: a title, text, a photograph, a video, a graphs, a 3D-object, a website, a social media feed, and any combination thereof.

### Claim 4 (depends on 1)

The method according to claim 1, wherein the one or more augmented-reality objects include a data source from an application programming interface.

### Claim 5 (depends on 1)

The method according to claim 1, wherein the video feed has a given frame rate, and wherein receiving the augmented-reality objects from the cloud-based, remote computer server comprises receiving the augmented-reality objects from the cloud-based, remote computer server at a frame rate that matches the given frame rate.

### Claim 6 (depends on 1)

The method according to claim 1, wherein identifying the one or more dispositions within image frames belonging to the video feed comprises, for respective image frames belonging to the video feed, identifying dispositions that are different from each other.

### Claim 7 (depends on 1)

The method according to claim 1,
further comprising, in real-time with respect to the recording of the video feed, selecting the one or more augmented-reality objects that are to be overlaid upon respective portions of the video feed,
wherein receiving the augmented-reality objects from the cloud-based, remote computer server comprises receiving the selected augmented-reality objects from the cloud-based, remote computer server in real-time with respect to the selecting of the one or more augmented-reality objects.

### Claim 8

(canceled)

### Claim 9 (depends on 1)

The method according to claim 1, further comprising receiving a gesture from a user who appears within the video feed, and in response thereto adjusting the augmented-reality object.

### Claim at position 10

10-12. (canceled)

### Claim 13 (depends on 1)

The method according to claim 1, wherein receiving the one or more augmented-reality objects from the cloud-based, remote computer server comprises receiving an alpha channel that contains the one or more augmented-reality objects from the cloud-based, remote computer server.

### Claim 14 (depends on 13)

The method according to claim 13, wherein receiving the alpha channel from the cloud-based, remote computer server comprises receiving an alpha channel that is generated using a gaming engine.

### Claim 15 (depends on 1)

The method according to claim 1, wherein identifying one or more dispositions within image frames belonging to the video feed comprises identifying dispositions of one or more physical markers that are located within the image frames belonging to the video feed.

### Claim 16 (depends on 15)

The method according to claim 15, further comprising at least partially reducing a visibility of the one or more physical markers within the image frames.

### Claim 17

(canceled)

### Claim 18 (depends on 16)

The method according to claim 16, wherein reducing the visibility of the one or more physical markers within the image frame comprises, within each of the image frames:
identifying characteristics of areas of the image frame that surround each of the one or more physical markers, and
generating masks to overlay upon the one or more markers, such that the masks blend in with corresponding surrounding areas.

### Claim 19 (depends on 16)

The method according to claim 16, wherein reducing the visibility of the one or more physical markers within the image frame comprises running a machine-learning algorithm that generates masks to overlay upon the one or more markers, such that the masks blend in with areas that surround each of the one or more physical markers.

### Claim 20 (depends on 1)

The method according to claim 1, further comprising automatically matching lighting-related parameters of the one or more augmented-reality objects with lighting-related parameters within image frames of the video feed.

### Claim 21 (depends on 20)

The method according to claim 20, wherein automatically matching the lighting-related parameters comprises matching one or more lighting-related parameters selected from the group consisting of: light intensity, light-source angle, white balance, light-source type, and light-source position.

### Claim 22 (depends on 20)

The method according to claim 20, wherein automatically matching the lighting-related parameters comprises automatically matching the lighting-related parameters by running a machine learning-algorithm.

### Claim 23 (depends on 20)

The method according to claim 20, wherein automatically matching the lighting-related parameters comprises determining lighting-related parameters within the image frames, and applying lighting-related parameters to the augmented-reality objects based on the lighting-related parameters that were determined within the image frames.

### Claim 24 (depends on 20)

The method according to claim 20, wherein automatically matching the lighting-related parameters comprises determining lighting-related parameters to apply to the augmented-reality objects in order to match the lighting-related parameters of the augmented-reality objects to those of the image frames, without directly determining the lighting-related parameters within the image frames.

### Claim 25

(canceled)

### Claim 26

An apparatus for publishing video content on a video output device, based upon a video feed that is recorded at a first site, the apparatus comprising:
one or more computer processors configured, in real-time with respect to the recording of the video feed, to:
identify one or more dispositions within image frames belonging to the video feed;
communicate data that are indicative of the one or more dispositions within the image frames belonging to the video feed to a cloud-based, remote computer server that is remote from the first site;
receive one or more augmented-reality objects from the cloud-based, remote computer server, the augmented-reality objects being positioned and oriented to correspond to the positions identified within the image frames belonging to the video feed; and
publish the video feed on the video output device, with the augmented-reality objects overlaid upon the image frames.

### Claim 27

(canceled)

### Claim 28 (depends on 26)

The apparatus according to claim 26, wherein the one or more augmented-reality objects include one or more augmented-reality objects selected from the group consisting of: a title, text, a photograph, a video, a graphs, a 3D-object, a website, a social media feed, and any combination thereof.

### Claim 29 (depends on 26)

The apparatus according to claim 26, wherein the one or more augmented-reality objects include a data source from an application programming interface.

### Claim 30 (depends on 26)

The apparatus according to claim 26, wherein the video feed has a given frame rate, and wherein the one or more computer processors are configured to receive the augmented-reality objects from the cloud-based, remote computer server at a frame rate that matches the given frame rate.

### Claim 31 (depends on 26)

The apparatus according to claim 26, wherein the one or more computer processors are configured to identify the one or more dispositions within image frames belonging to the video feed by identifying dispositions that are different from each other, for respective image frames belonging to the video feed.

### Claim 32 (depends on 26)

The apparatus according to claim 26, wherein the one or more computer processors are configured:
in real-time with respect to the recording of the video feed, to receive an input indicating a selection of the one or more augmented-reality objects that are to be overlaid upon respective portions of the video feed, and
to receive the selected augmented-reality objects from the cloud-based, remote computer server in real-time with respect to the selecting of the one or more augmented- reality objects.

### Claim 33

(canceled)

### Claim 34 (depends on 26)

The apparatus according to claim 26, wherein the one or more computer processors are configured to receive a gesture from a user who appears within the video feed, and in response thereto to adjust the augmented-reality object.

### Claim at position 33

35-37. (canceled)

### Claim 38 (depends on 26)

The apparatus according to claim 26, wherein the one or more computer processors are configured to receive the one or more augmented-reality objects from the cloud-based, remote computer server by receiving an alpha channel that contains the one or more augmented-reality objects from the cloud-based, remote computer server.

### Claim 39 (depends on 38)

The apparatus according to claim 38, wherein the one or more computer processors are configured to receive the alpha channel from the cloud-based, remote computer server by receiving an alpha channel that is generated using a gaming engine.

### Claim 40 (depends on 26)

The apparatus according to claim 26, wherein the one or more computer processors are configured to identify the one or more dispositions within image frames belonging to the video feed by identifying dispositions of one or more physical markers that are located within the image frames belonging to the video feed.

### Claim 41 (depends on 40)

The apparatus according to claim 40, wherein the one or more computer processors are configured to at least partially reduce a visibility of the one or more physical markers within the image frames.

### Claim 42

(canceled)

### Claim 43 (depends on 41)

The apparatus according to claim 41, wherein the one or more computer processors are configured to at least partially reduce the visibility of the one or more physical markers within the image frame by, within each of the image frames:
identifying characteristics of areas of the image frame that surround each of the one or more physical markers, and
generating masks to overlay upon the one or more markers, such that the masks blend in with corresponding surrounding areas.

### Claim 44 (depends on 41)

The apparatus according to claim 41, wherein the one or more computer processors are configured to at least partially reduce the visibility of the one or more physical markers within the image frame by running a machine-learning algorithm that generates masks to overlay upon the one or more markers, such that the masks blend in with areas that surround each of the one or more physical markers.

### Claim 45 (depends on 26)

The apparatus according to claim 26, wherein the one or more computer processors are configured to automatically match lighting-related parameters of the one or more augmented-reality objects with lighting-related parameters within image frames of the video feed.

### Claim 46 (depends on 45)

The apparatus according to claim 45, wherein the one or more computer processors are configured to automatically match one or more lighting-related parameters selected from the group consisting of: light intensity, light-source angle, white balance, light-source type, and light-source position.

### Claim 47 (depends on 45)

The apparatus according to claim 45, wherein the one or more computer processors are configured to automatically match the lighting-related parameters by running a machine learning-algorithm.

### Claim 48 (depends on 45)

The apparatus according to claim 45, wherein the one or more computer processors are configured to automatically match the lighting-related parameters by determining lighting-related parameters within the image frames, and applying lighting-related parameters to the augmented-reality objects based on the lighting-related parameters that were determined within the image frames.

### Claim 49 (depends on 45)

The apparatus according to claim 45, wherein the one or more computer processors are configured to automatically match the lighting-related parameters by determining lighting-related parameters to apply to the augmented-reality objects in order to match the lighting-related parameters of the augmented-reality objects to those of the image frames, without directly determining the lighting-related parameters within the image frames.

### Claim 50

An apparatus for publishing video content on a video output device, based upon a video feed that is recorded at a first site, the apparatus comprising:
one or more computer processors configured, in real-time with respect to the recording of the video feed, and using a cloud-based computer server disposed at a second site that is remote from the first site:
to receive an identification of one or more dispositions identified within image frames belonging to the video feed;
to receive an indication of one or more augmented-reality objects to be displayed within the video feed; and
to publish the video feed with the augmented-reality objects overlaid upon the image frames belonging to the video feed at positions and orientations corresponding to the one or more dispositions that were identified within the image frames.

### Claim at position 47

51-52. (canceled)
