# US 10,121,512 B2 · System and method for providing and interacting with coordinated presentations

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,121,512 B2
- Document ID: US10121512B2
- Status: Granted
- Kind: B2
- Application number: 15/853,377
- Filed: 2017-12-22
- Published: 2018-05-03
- Granted: 2018-11-06
- Earliest claimed: 2013-06-26
- Assignees: Touchcast LLC
- Applicants: Touchcast LLC
- Inventors: Edo Segal; Dmytro Panin
- Web page: https://patentgrep.com/patent/US10121512B2

## CPC

- G11B 27/031: Electronic editing of digitised analogue information signals, e.g. audio or video signals
- H04N 5/2222: {Prompting}
- H04N 5/2226: {Determination of depth image, e.g. for foreground/background separation (determining depth by image analysis in general G06T7/50; segmentation by image analysis in general G06T7/10)}
- H04N 5/265: Mixing
- G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Disclosed is a system and method for generating a coordinated presentation. Content selected by a user is curated, and a plurality of images are captured for inclusion. A first data stream for the curated content and a second data stream for the captured images are received. A portion of a subject within each second data stream image is defined. An appearance of movement is tracked, and at least some of the plurality of images in the second data stream is modified. The respective content associated with the two data streams is integrated, including the modified at least some of the plurality of images, to generate the coordinated presentation that is capable of transmission to and receipt by one or more remote devices, and wherein the coordinated presentation is configured to enable interaction with at least a portion of the curated content at each of the one or more remote devices.

## Claims

### Claim 1

A system for generating a coordinated presentation, comprising:
a computing device having a processor and a memory, the computing device being configured by code stored in the memory and executed by the processor to:
receive a first data stream associated with first content and a second data stream associated with images captured via an image capture device, wherein none of the images captured via the image capture device are included in the first content;
define a portion of a subject within each of the plurality of images in the second data stream, wherein the portion comprises less than any one image;
track an appearance of movement of the portion of the subject within each of the plurality of images;
modify, as a function of the tracked appearance of movement, at least some of the plurality of images in the second data stream by displaying the portion in a single position; and
integrate respective content associated with the two data streams, including the modified at least some of the plurality of images, to generate the coordinated presentation that is capable of transmission to and receipt by one or more remote devices.

### Claim 2 (depends on 1)

The system of claim 1, wherein the computing device is further configured by code stored in the memory and executed by the processor to:
process telemetry information associated with at least one of a gyroscope and accelerometer, wherein the tracked appearance of movement is based on the telemetry information.

### Claim 3 (depends on 2)

The system of claim 2, wherein the telemetry information represents computing device movement associated with distance, speed and direction in at least one of an X-axis, a Y-axis and a Z-axis.

### Claim 4 (depends on 2)

The system of claim 2, wherein the computing device is further configured by code stored in the memory and executed by the processor to alter placement and/or alter an angle of view of the at least some of the content in the first data stream.

### Claim 5 (depends on 2)

The system of claim 2, wherein the content in the first data stream includes a 360 degree horizontal view and a 180 degree vertical view, and
wherein the computing device is further configured by code stored in the memory and executed by the processor to:
control an angle, distance and/or viewpoint appearance of content in the first stream of data as a function of the telemetry information.

### Claim 6 (depends on 1)

The system of claim 1, wherein the computing device is further configured by code stored in the memory and executed by the processor to:
alter appearance of content in the second data stream, including position in a frame of the coordinated presentation as a function of input received in an authoring tool interface.

### Claim 7 (depends on 1)

The system of claim 1, wherein the computing device is further configured by code stored in the memory and executed by the processor to:
substitute a portion of content in the second data stream with at least a portion of content in the first data stream as a function of at least a chroma value appearing in the content in the second data stream.

### Claim 8 (depends on 1)

The system of claim 1, wherein the angle, distance and/or viewpoint of content in the first stream of data is controlled by adjusting the first stream of data to correspond oppositely to appearance of content in the second data stream.

### Claim 9 (depends on 1)

The system of claim 1, wherein the computing device is further configured by code stored in the memory and executed by the processor to:
position content associated with second data stream to appear virtually integrated into the first data stream.

### Claim 10 (depends on 1)

The system of claim 1, wherein the computing device is further configured by code stored in the memory and executed by the processor to modify at least some of the content including by changing perspective, skew, brightness, contrast and/or saturation.

### Claim 11

A method for generating a coordinated presentation, comprising:
receiving, by the computing device, a first data stream associated with first content and a second data stream associated with images captured via an image capture device, wherein none of the images captured via the image capture device are included in the first content;
defining, by the computing device, a portion of a subject within each of the plurality of images in the second data stream, wherein the portion comprises less than any one image;
tracking, by the computing device, an appearance of movement of the portion of the subject within each of the plurality of images;
modifying, by the computing device as a function of the tracked appearance of movement, at least some of the plurality of images in the second data stream by displaying the portion in a single position; and
integrating, by the computing device, respective content associated with the two data streams, including the modified at least some of the plurality of images, to generate the coordinated presentation that is capable of transmission to and receipt by one or more remote devices.

### Claim 12 (depends on 11)

The method of claim 11, further comprising:
processing, by the computing device, telemetry information associated with at least one of a gyroscope and accelerometer, wherein the tracked appearance of movement is based on the telemetry information.

### Claim 13 (depends on 12)

The method of claim 12, wherein the telemetry information represents computing device movement associated with distance, speed and direction in at least one of an X-axis, a Y-axis and a Z-axis.

### Claim 14 (depends on 12)

The method of claim 12, further comprising:
altering, by the computing device, placement and/or alter an angle of view of the at least some of the content in the first data stream.

### Claim 15 (depends on 12)

The method of claim 12, wherein the content in the first data stream includes a 360 degree horizontal view and a 180 degree vertical view, and
further comprising:
controlling, by the computing device, an angle, distance and/or viewpoint appearance of content in the first stream of data as a function of the telemetry information.

### Claim 16 (depends on 11)

The method of claim 11, further comprising:
altering, by the computing device, appearance of content in the second data stream, including position in a frame of the coordinated presentation as a function of input received in an authoring tool interface.

### Claim 17 (depends on 11)

The method of claim 11, further comprising:
substituting, by the computing device, a portion of content in the second data stream with at least a portion of content in the first data stream as a function of at least a chroma value appearing in the content in the second data stream.

### Claim 18 (depends on 11)

The method of claim 11, wherein the angle, distance and/or viewpoint of content in the first stream of data is controlled by adjusting the first stream of data to correspond oppositely to appearance of content in the second data stream.

### Claim 19 (depends on 11)

The method of claim 11,
further comprising:
positioning, by the computing device, content associated with second data stream to appear virtually integrated into the first data stream.

### Claim 20 (depends on 11)

The method of claim 11, further comprising: modifying at least some of the content including by changing perspective, skew, brightness, contrast and/or saturation.
