# US 2013/0156091 A1 · Networked image/video processing system for enhancing photos and videos

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2013/0156091 A1
- Document ID: US20130156091A1
- Status: Published application
- Kind: A1
- Application number: 13/327,680
- Filed: 2011-12-15
- Published: 2013-06-20
- Earliest claimed: 2011-12-15
- Assignees: Imerj LLC
- Inventors: Wei Li; Bill Reckwerdt
- Web page: https://patentgrep.com/patent/US20130156091A1

## CPC

- H04N 19/85: using pre-processing or post-processing specially adapted for video compression
- H04N 19/115: Selection of the code volume for a coding unit prior to coding
- H04N 19/117: Filters, e.g. for pre-processing or post-processing (sub-band filter banks H04N19/635)
- H04N 19/164: Feedback from the receiver or from the transmission channel
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A distributed image/video processing system is disclosed herein wherein one or more of digital image/video recorders (e.g., a digital cameras, video recorders, or smart phones, etc.) are in network communication with central network site for transmitting image or video data thereto. The recorders process their image/video data dependent upon an estimate of a measurement of network bandwidth that is available for transmitting image or video data to the central network site.

## Claims

### Claim 1

A method for processing data, comprising:
obtaining first data at a first device operably in communication with a network site via a telecommunications network, the first data including image or video data;
obtaining one or more first characteristics for the first data, wherein the first characteristics include a size or data rate for the first data;
obtaining one or more transmission characteristics for transmitting the first data or a data derived therefrom on the network;
correlating the first characteristics with the transmission characteristics for operably configuring at least two processes obtained from different ones of the following collections: (a) a compression collection of one or more data compression techniques, (b) a de-noising collection of one or more a de-noising techniques, and (c) a sharpening collection of one or more a sharpening techniques;
wherein the at least two techniques transform the first data or data derived therefrom into corresponding processed data for transmitting on the network;
applying the at least two techniques for transforming the first data or data derived therefrom;
obtaining history information indicative of transforming the first data to obtain the processed data, wherein the history information includes description information related to the at least two techniques applied for transforming the first data; and
transmitting the processed data and the history information, via the network, to a predetermined network site;
wherein following the transmission, the transmitted history information is accessed for at least decompressing the transmitted processed data when the transmitted processed data is compressed.

### Claim 2 (depends on 1)

The method of claim 1, wherein the applying step includes applying one of the sharpening techniques to the first data or data derived therefrom.

### Claim 3 (depends on 1, 2)

The method of claim 2, wherein at least most of the steps claim 1 are performed by the first device.

### Claim 4 (depends on 2)

The method of claim 2, wherein the applying step includes applying one of the data compression techniques to the first data or data derived therefrom.

### Claim 5 (depends on 2)

The method of claim 2, wherein the one sharpening technique includes one of a deconvolution technique and an unsharp masking technique.

### Claim 6 (depends on 1)

The method of claim 1, wherein the transmission characteristics are dependent upon one or more of: an available network bandwidth, a network transmission time delay, a network data rate, and a maximum transmission time delay threshold.

### Claim 7 (depends on 6)

The method of claim 6, wherein the transmission characteristics are dependent upon at least the maximum transmission time delay threshold.

### Claim 8 (depends on 1)

The method of claim 1, wherein the step of applying includes activating one of first and second sharpening processes obtained from the sharpening collection, wherein the first sharpening process sharpens the first data or data derived therefrom less than the second sharpening process;
wherein the first sharpening process is activated when a first data compression process, obtained from the compression collection, is designated for compressing the first data or data derived therefrom; and
wherein the second sharpening process is activated when the second data compression process, obtained from the compression collection, is designated for compressing the first data or data derived therefrom;
wherein the first data compression process compresses data less than the second data compression process.

### Claim 9 (depends on 1)

The method of claim 1, wherein the transmitted history information is accessed for enhancing the processed data by activating one or more of: a de-noising process, a sharpening process, an auto-exposure process, an auto-white balance process, and an auto-focus process.

### Claim 10 (depends on 1)

The method of claim 1, further including a step of determining whether one or more of an auto-exposure, auto-white balance, and auto-focus is to be performed prior to the step of obtaining the first data, wherein the step of determining prevents at least one of the auto-exposure, auto-white balance, and auto-focus from being performed when the network data is indicative of an available network bandwidth below a predetermined threshold.

### Claim 11 (depends on 1)

The method of claim 1, wherein the transmission characteristics includes a preferred size, data rate or an elapsed time.

### Claim 12 (depends on 1)

The method of claim 1, wherein the network site does not perform further video or image enhancement of the processed data.

### Claim 13

A computer readable medium, comprising:
machine instructions for performing the following steps:
obtaining for a first device, first image or video data, the first device being in operable communication with a network site via a telecommunications network;
obtaining one or more first characteristics of the first data, wherein the characteristics include a size or data rate for the first data;
obtaining enhanced data obtained from enhancing of the first image or video data, or data derived therefrom;
wherein for obtaining the enhance data, the first image or video data or data derived therefrom is input to a first sharpening process when a first data compression is designated for compressing the enhanced data or data derived therefrom;
wherein for obtaining the enhance data, the first image or video data or data derived therefrom is input to a second sharpening process when a second data compression is designated for compressing the enhanced data or data derived therefrom;
wherein the first data compression compresses more than the second data compression;
wherein the first sharpening process sharpens more than the second sharpening process;
wherein processed data is obtained from compressing the enhanced data or data derived therefrom with one of the first data compression and the second data compression according to one or more transmission characteristics for transmitting the processed data on the network;
obtaining history information indicative of processing of the first image or video data, wherein the history information includes compression description information related to the processed data, and also includes sharpening description information indicative of sharpening performed for obtaining the enhanced data; and
transmitting the processed data and the history information, via the network, to the network site.

### Claim 14 (depends on 13)

The computer readable medium of claim 13, where the step of obtaining the enhanced data includes de-noising the first image or video data, or data derived therefrom, wherein the de-noising reduces a salt and pepper noise or a Gaussian noise.

### Claim 15 (depends on 13)

The computer readable medium of claim 13, wherein the first device generates the first image or video data.

### Claim 16

A system for processing image or video data comprising:
an image or video recorder having the following (a) through (e):
(a) an image or video generator for generating image or video data;
(b) one or more enhancement processes for enhancing the image or video data, or a version derived therefrom resulting in enhanced data, wherein the enhancement processes include one or more sharpening processes;
(c) a compressor for compressing the enhanced data resulting in processed data;
(d) an evaluator for determining whether network data, related to a transmission characteristic for a network in operable communication with the recorder, is indicative of: (i) a first specification of the transmission characteristic, or (ii) a second specification of the transmission characteristic;
wherein the first specification is indicative of a more constrained operational condition for performing a transmission on the network than the second specification;
wherein the first specification corresponds to a first data compression, and the second specification corresponds to a second data compression;
wherein the first data compression compresses data more than the second data compression;
wherein prior to the first data compression being performed on the enhanced data, a first of the sharpening processes is performed for obtaining the enhanced data indicative of a first sharpened content, and
wherein prior to the second data compression being performed on the enhanced data, a second of the sharpening processes is performed for obtaining the enhanced data indicative of a second sharpened content;
wherein the first sharpening process sharpens more than the second sharpening process;
wherein history information indicative of processing of the image or video data to yield the processed data is obtained, wherein the history information includes compression description information related to which of the first and second data compressions were performed, and including enhancement description information indicative of the enhancement processes performed to obtain the enhanced data; and
(e) an interface to the network for transmitting the processed data and the history information, via the network, to a predetermined network site;
wherein following the network transmission, the transmitted history information is accessed for decompressing the transmitted processed data.

### Claim 17 (depends on 16)

The system of claim 16, wherein the evaluator compares the network data with data indicative of a predetermined available bandwidth for the network or a maximum transmission time.

### Claim 18 (depends on 16)

The system of claim 16, wherein the enhancement processes includes a de-noising process for de-noising the image or video data, or a version derived therefrom, wherein the de-noising is decreased when the first data compression is performed, and the de-noising is increased when the second data compression is performed.
