# US 2018/0300462 A1 · System for Interactive Matrix Manipulation Control of Streamed Data and Media

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2018/0300462 A1
- Document ID: US20180300462A1
- Status: Published application
- Kind: A1
- Application number: 15/997,426
- Filed: 2018-06-04
- Published: 2018-10-18
- Earliest claimed: 2007-04-16
- Assignees: TailStream Technologies, LLC
- Applicants: TailStream Technologies, LLC
- Inventors: Kelley Wise
- Web page: https://patentgrep.com/patent/US20180300462A1

## CPC

- H04L 63/102: {Entity profiles}
- G06F 9/45558: {Hypervisor-specific management and integration aspects}
- G06F 21/53: by executing in a restricted environment, e.g. sandbox or secure virtual machine
- G06F 21/62: Protecting access to data via a platform, e.g. using keys or access control rules
- H04L 63/0428: {wherein the data content is protected, e.g. by encrypting or encapsulating the payload}
- H04L 63/08: {for authentication of entities (cryptographic mechanisms or cryptographic arrangements for entity authentication H04L9/32)}
- H04L 65/752: adapting media to network capabilities
- H04N 1/32702: {using digital control signals (H04N1/32704, H04N1/32614, H04N1/32771 take precedence)}
- H04N 1/32793: {Controlling a receiver or transmitter non-communication function in response to a communication control signal}
- H04N 21/23892: {involving embedding information at multiplex stream level, e.g. embedding a watermark at packet level}
- H04N 21/2541: {Rights Management (protecting software against unauthorised usage in a vending or licensing environment G06F21/10; security in data switching network management H04L41/28; security management or policies for network security H04L63/20; access security in wireless networks H04W12/08)}
- H04N 21/4402: involving reformatting operations of video signals for household redistribution, storage or real-time display {(details of conversion of video standards at pixel level H04N7/01; video transcoding H04N19/40; adapting incoming signals to the display format of the display terminal G09G5/005; media handling at the source in data packet switching networks H04L65/764)}
- H04N 21/443: OS processes, e.g. booting an STB, implementing a Java virtual machine in an STB or power management in an STB
- H04N 21/6543: for forcing some client operations, e.g. recording {(remote booting in general G06F9/4416)}
- G06F 21/1015: {to users}
- G06F 2009/45595: {Network integration; Enabling network access in virtual machine instances}
- G06F 2221/034: Test or assess a computer or a system
- H04L 2463/101: applying security measures for digital rights management
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

An interactive streaming media and application service provider system can securely stream high resolution, multiple formats of video and data. Different data sets can be included in a single stream. A rights management system controls matrix manipulation and other aspects of user control of the data, including one or more of rendering in various different 2D, 3D, or other media formats, reconstruction and modeling, zooming, frame grab, print frame, parental controls, picture in picture, preventing unauthorized copying, adapting to different data transmission formats, adapting to different resolutions and screen sizes, and actively control functionality contained in embedded data, encryption/decryption. Control can be exerted by an external entity through a user-side virtual machine. Control codes can optionally be embedded in the media, embedded in the user's device, and/or sent separately to the device.

## Claims

### Claim 1

A device selected from a group consisting of
a computer,
a tablet, and
a smart phone;
the device including
a display,
a network interface,
a persistent computer memory,
an operating system stored on the persistent memory,
a browser operating dependently on the operating system,
a virtual machine in the browser operating independently of the operating system;
the network interface configured to receive
a first streamed data set and
a first Boolean control code
from a network server;
the virtual machine including a matrix manipulation function at least partially under the control of the network server, the matrix manipulation function using the first Boolean control code to process the first streamed data set, within the virtual machine, into data, video, or image media; and
the display configured to present the data, video, or image media processed by the matrix manipulation function of the virtual machine.

### Claim 2 (depends on 1)

The device of claim 1 further comprising
a user input component configured to receive a user control code;
the first Boolean control code readable by the virtual machine and indicating the user control code is required to access the data, video, or image media in the first streamed data set;
the matrix manipulation function configured to use both
the first Boolean control code indicating the user control code is required and
the user control code
to process the first streamed data set, within the virtual machine, into the data, video, or image media.

### Claim 3 (depends on 2)

The device of claim 2 further comprising
the network interface configured to receive
a second streamed data set and
a second Boolean control code
the second Boolean control code readable by the virtual machine and indicating the user control code is not required to access the data, video, or image media in the second streamed data set; and
the matrix manipulation function, independently of the user control code, using the second Boolean control code
to process the second streamed data set, within the virtual machine, into data, video, or image media.

### Claim 4 (depends on 2)

The device of claim 2 wherein
the matrix manipulation function includes an authentication process between the user control code and the first Boolean control code to enable access to the data, video, or image media in the first streamed data set.

### Claim 5 (depends on 2)

The device of claim 2 further comprising
a transient computer memory,
wherein
the matrix manipulation function within the virtual machine processes the first streamed data set from the transient computer memory, and
the matrix manipulation function within the virtual machine buffers the data, video, or image media in the first streamed data into the transient computer memory.

### Claim 6 (depends on 5)

The device of claim 5 wherein
the transient computer memory includes computer readable instructions for the virtual machine, and
the persistent computer memory includes computer readable instructions for the browser.

### Claim 7 (depends on 1)

The device of claim 1 wherein
the network interface includes a wireless data transmitter.

### Claim 8 (depends on 1)

The device of claim 1 wherein
the display is configured to present a portion of the data, video, or image media processed by the matrix manipulation function of the virtual machine before the network interface receives all of the first streamed data set.

### Claim 9 (depends on 1)

The device of claim 1 wherein
the matrix manipulation function is configured to selectively process the first streamed data set into one of a plurality of different resolutions of data, video, or image media.

### Claim 10 (depends on 9)

The device of claim 9 further comprising
a user input component configured to receive a user control code;
the first Boolean control code readable by the virtual machine and indicating the user control code is required to process a first resolution of the data, video, or image media in the first streamed data set;
the matrix manipulation function configured to process a second resolution of the data, video, or image media in the first streamed data set without the user control code.

### Claim 11 (depends on 1)

The device of claim 1 wherein
the matrix manipulation function includes a manipulation selected from a group consisting of a zoom manipulation and a picture-in-picture manipulation.

### Claim 12

A system for providing data, video, or image media while preventing unauthorized viewing or copying of the data, video, or image media, the system comprising:
a network database storing the data, video, or image media;
a network server configured to encrypt the data, video, or image media into a first data set, the network server further configured to stream a network control code and the first data set to a user device; and
the user device including
instructions for an operating system and a browser stored on a non-transitory computer readable medium,
instructions for a matrix manipulation function within a virtual machine stored on a transitory computer readable medium, wherein the matrix manipulation function
is at least partially under the control of the network server and
is configured to use the network control code to process the streamed first data set, within the virtual machine, into the data, video, or image media,
a processor executing the instructions for the matrix manipulation function within the virtual machine within the browser and independently of the operating system to process the streamed first data set, and
a display configured to present the data, video, or image media processed by the processor.

### Claim 13 (depends on 12)

The system of claim 12 wherein
the non-transitory computer readable medium further includes a user control code, and
the matrix manipulation function is configured to use both the network control code and the user control code to process the streamed first data set into the data, video, or image media.

### Claim 14 (depends on 12)

The system of claim 12 wherein
the transitory computer readable medium further includes a user control code, and
the matrix manipulation function is configured to use both the network control code and the user control code to process the streamed first data set into the data, video, or image media.

### Claim 15

The system of 12 wherein
the transitory computer readable medium further includes a user control code;
the network control code includes an indicator with a first state or a second state;
the matrix manipulation function is configured to use the user control code and the network control code with the indicator in the first state to process the streamed first data set into the data, video, or image media; and
the matrix manipulation function is configured to use the network control code with the indicator in the second state to process the streamed first data set into the data, video, or image media without the use of the user control code.

### Claim 16

The system of 12 wherein
the user device includes a network interface with a wireless data transmitter for receiving the network control code and the first data set from the network server; and
the user device is configured to present a portion of the data, video, or image media processed by the processor on the display before all of the streamed first data set is received from the network server via the network interface.

### Claim 17 (depends on 12)

The system of claim 12 wherein
wherein the processor reads the streamed first data set from the transitory computer readable medium and writes the data, video, or image media to the transitory computer readable medium.

### Claim 18 (depends on 12)

The system of claim 12 wherein
the instructions for the matrix manipulation function include instructions for removing an active digital watermark from the streamed first data set.
