# US 9,883,235 B2 · Video motion augmentation

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 9,883,235 B2
- Document ID: US9883235B2
- Status: Granted
- Kind: B2
- Application number: 14/925,233
- Filed: 2015-10-28
- Published: 2017-05-04
- Granted: 2018-01-30
- Earliest claimed: 2015-10-28
- Assignees: AT&T Intellectual Property I, L.P.
- Applicants: At&T Intellectual Property I, L.P.
- Inventors: Eric Zavesky; James E. Jackson; James H. Pratt
- Web page: https://patentgrep.com/patent/US9883235B2

## CPC

- H04N 21/41265: {having a remote control device for bidirectional communication between the remote control device and client device (unidirectional remote control device H04N21/42204)}
- G06F 16/9577: {Optimising the visualization of content, e.g. distillation of HTML documents}
- G06T 5/50: using two or more images, e.g. averaging or subtraction
- G06V 20/46: {Extracting features or characteristics from the video content, e.g. video fingerprints, representative shots or key frames}
- G06V 40/20: Movements or behaviour, e.g. gesture recognition (recognition of facial expressions G06V40/16)
- H04N 21/23418: {involving operations for analysing video streams, e.g. detecting features or characteristics (television picture signal circuitry for scene change detection H04N5/147; filtering for image enhancement G06T5/00; methods or arrangements for recognising scenes G06V20/00; arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59)}
- H04N 21/234363: {by altering the spatial resolution, e.g. for clients with a lower screen resolution}
- H04N 21/23439: {for generating different versions}
- H04N 21/25825: {involving client display capabilities, e.g. screen resolution of a mobile phone (optimising the visualisation of content during browsing in the Internet G06F16/9577; processing of terminal status or physical abilities in wireless networks H04W8/22; authentication in wireless network security H04W12/06)}
- H04N 21/431: Generation of visual interfaces {for content selection or interaction}; Content or additional data rendering
- H04N 21/4358: {for generating different versions, e.g. for different peripheral devices}
- H04N 21/44008: {involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream (arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59)}
- H04N 21/4516: {involving client characteristics, e.g. Set-Top-Box type, software version or amount of memory available}
- H04N 21/4758: {for providing answers, e.g. voting}
- H04N 21/6131: {involving transmission via a mobile phone network (wireless downlink channel access H04W74/006)}
- G06T 2207/10016: Video; Image sequence
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

A system for providing video motion augmentation is disclosed. In particular, the system provides mechanisms for analyzing video content, metadata, or a combination thereof, to dynamically enhance and adapt regions of small movements or micro-movements in the video content based on a variety of inputs. The regions of small movements or micro-movements may be enhanced based on device characteristics associated with a device consuming the video content, based on a theme associated with the content, based on sensor data, based on user feedback, and based on a variety of other inputs. For example, motion content in the video content may be enhanced and emphasized based on the display resolution or other device characteristics of a device requesting the video content. Once the enhanced video content is generated based on the inputs, the enhanced content may be provided to the device requesting the content.

## Claims

### Claim 1

A system, comprising:
a memory that stores instructions;
a processor that executes the instructions to perform operations, the operations comprising:
receiving, from a device, a request for media content;
transmitting, in response to the request, a first version of the media content to the device;
receiving, while the first version of the media content is being transmitted, a communication indicating a device characteristic of the device;
enhancing a portion of the first version of the media content based on the device characteristic of the device, based on a type of environment that the device is located in, based on a light level associated with the device requesting the media content, based on a type of motion content in the first version of the media content, and based on an orientation of the device, wherein the portion enhanced comprises the motion content in the first version of the media content;
generating a second version of the media content including the portion of the first version of the media content enhanced based on the device characteristic of the device; and
transmitting, to the device, the second version of the media content for display on the device.

### Claim 2 (depends on 1)

The system of claim 1, wherein the operations further comprise enhancing the portion of the first version of the media content based on metadata embedded within the first version of the media content.

### Claim 3 (depends on 2)

The system of claim 2, wherein the operations further comprise enhancing the portion of the first version of the media content based on a theme associated with the first version of the media content, and wherein the operations further comprise generating a third version of the media content including the portion of the first version of the media content enhanced based on the metadata and the theme.

### Claim 4 (depends on 1)

The system of claim 1, wherein the operations further comprise receiving sensor data from a sensor of the device, and wherein the operations further comprise enhancing the portion of the first version of the media content based on the sensor data.

### Claim 5 (depends on 1)

The system of claim 1, wherein the operations further comprise receiving feedback from a user of the device, wherein the feedback is associated with the second version of the media content, and wherein the operations further comprise enhancing motion content of the second version of the media content based on the feedback.

### Claim 6 (depends on 1)

The system of claim 1, wherein the operations further comprise dynamically enhancing a region of micro-movement in the motion content of the first version of the media content.

### Claim 7 (depends on 1)

The system of claim 1, wherein the operations further comprise receiving aggregated feedback from a user of the device and a plurality of other users, and wherein the operations further comprise enhancing motion content of the second version of the media content based on the aggregated feedback.

### Claim 8 (depends on 1)

The system of claim 1, wherein the operations further comprise enhancing the portion of the first version of the media content by emphasizing movements in motion content.

### Claim 9 (depends on 1)

The system of claim 1, wherein the operations further comprise detecting movements in the motion content of the first version of the media content based on an object-specific rule.

### Claim 10 (depends on 1)

The system of claim 1, wherein the operations further comprise enhancing the portion of the first version of the media content by utilizing seam filling.

### Claim 11 (depends on 1)

The system of claim 1, wherein the operations further comprise determining motion frequencies for the motion content in the first version of the media content.

### Claim 12 (depends on 1)

The system of claim 1, wherein the operations further comprise exporting, to a haptic component of the device, information associated with the motion content enhanced based on the device characteristic, and wherein the haptic component outputs haptic vibration feedback corresponding to the motion content enhanced based on the device characteristic.

### Claim 13

A method, comprising:
receiving, from a device, a request for media content;
receiving a communication indicating a device characteristic of the device;
enhancing, by utilizing instructions from a memory that are executed by a processor, a portion of a first version of the media content based on the device characteristic of the device, based on a type of environment that the device is located in, based on a light level associated with the device requesting the media content, based on a type of motion content in the first version of the media content, and based on an orientation of the device, wherein the portion enhanced comprises the motion content in the first version of the media content;
generating a second version of the media content including the portion of the first version of the media content enhanced based on the device characteristic of the device; and
transmitting, to the device and in response to the request, the second version of the media content for display on the device.

### Claim 14 (depends on 13)

The method of claim 13, further comprising enhancing non-motion content in the first version of the media content based on the device characteristic.

### Claim 15 (depends on 14)

The method of claim 14, further comprising generating a third version of the media content including the non-motion content enhanced based on the device characteristic.

### Claim 16 (depends on 13)

The method of claim 13, further comprising enhancing the portion of the first version of the media content based on metadata embedded within the first version of the media content.

### Claim 17 (depends on 13)

The method of claim 13, further comprising receiving sensor data from a sensor of the device, and wherein the operations further comprise enhancing the portion of the first version of the media content based on the sensor data.

### Claim 18 (depends on 13)

The method of claim 13, further comprising detecting movements in the motion content of the first version of the media content based on an object-specific rule.

### Claim 19 (depends on 13)

The method of claim 13, further comprising enhancing the portion of the first version of the media content by emphasizing movements in motion content.

### Claim 20

A computer-readable device comprising instructions, which when executed by a processor, cause the processor to perform operations comprising:
receiving, from a device, a request for media content;
receiving a communication indicating a device characteristic of the device;
enhancing a portion of a first version of the media content based on the device characteristic of the device, based on a type of environment that the device is located in, based on a light level associated with the device requesting the media content, based on a type of motion content in the first version of the media content, and based on an orientation of the device, wherein the portion enhanced comprises the motion content in the first version of the media content;
generating a second version of the media content including the portion of the first version of the media content enhanced based on the device characteristic of the device; and
transmitting, to the device and in response to the request, the second version of the media content for display on the device.
