# US 2020/0351229 A1 · Image matching server network implementing a score based on a function of latency between a server and an image store

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0351229 A1
- Document ID: US20200351229A1
- Status: Published application
- Kind: A1
- Application number: 16/935,448
- Filed: 2020-07-22
- Published: 2020-11-05
- Earliest claimed: 2014-07-15
- Assignees: Zebrafish Labs, Inc.
- Applicants: Zebrafish Labs, Inc.
- Inventors: Christopher Zacharias; Jeremy Larkin; David Birdsong
- Web page: https://patentgrep.com/patent/US20200351229A1

## CPC

- H04L 51/10: Multimedia information
- H04L 67/101: based on network conditions
- H04L 67/1023: based on a hash applied to IP addresses or costs
- H04L 67/61: taking into account QoS or priority requirements
- H04L 67/06: specially adapted for file transfer, e.g. file transfer protocol [FTP]
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)

## Abstract

Technology is disclosed for feeding source images from image stores of client systems into an image processing system using image feeding servers (“the technology”). The technology includes multiple image feeding servers that can feed a source image to the image processing system, using which the image processing system can generate processed images to be served to end users. The image feeding servers can be installed at various locations, e.g., geographically spread, and more proximate to where the source images are stored. An image feeding server obtains the source image from the image store in original size, downsizes the source image, and transmits the downsized source image to the image processing system. The technology selects an image feeding server based on a score of the image feeding server. The score can be determined as a function of one or more image feeding server parameters, e.g., latency, workload, or computing resource.

## Claims

### Claim at position 1

1-20. (canceled)

### Claim 21

A method comprising:
receiving, at an image processing system, a first request from a client system for serving a first image to a user device;
receiving, at the image processing system, an intermediate image from a first server, wherein the receiving includes:
transmitting, by the image processing system, a second request for response to each of multiple servers;
receiving, by the image processing system, a response from each server of a subset of the multiple servers for performing a task on a source image, the response including a corresponding score indicative of a match of corresponding server of the multiple servers to perform the task on the source image;
sending, by the image processing system, a message to the first server to perform the task;
processing, by the image processing system, the intermediate image to generate the first image; and
transmitting, by the image processing system, the first image to the client system for further transmission to the user device.

### Claim 22 (depends on 21)

The method of claim 21, wherein the corresponding score of each corresponding server is determined as a function of latency between the corresponding server and an image store from which the corresponding server is to obtain the source image.

### Claim 23 (depends on 21)

The method of claim 21, wherein the first server includes a first score that satisfies a selection criterion.

### Claim 24 (depends on 22)

The method of claim 22, wherein sending the message to perform the task includes sending the message to:
obtain the source image from the image store associated with the client system, the source image having a first file size, and
downsize the source image to generate the intermediate image, the intermediate image having a second file size, the second file size being smaller than the first file size.

### Claim 25 (depends on 21)

The method of claim 21, wherein the intermediate image has a resolution less than that of the source image.

### Claim 26 (depends on 21)

The method of claim 21, wherein the intermediate image is a file format different from that of the source image.

### Claim 27 (depends on 21)

The method of claim 21, wherein the intermediate image has lesser number of colors than in the source image.

### Claim 28 (depends on 21)

The method of claim 21, wherein the intermediate image is a compressed file whereas the source image is not a compressed file.

### Claim 29 (depends on 21)

The method of claim 21, wherein receiving the first request from the client system includes:
receiving the first request at the image processing system in response to a user request received at the client system from the user device.

### Claim 30 (depends on 21)

The method of claim 21, wherein the first server has a first latency with the image store and a second latency with the image processing system, the first latency being lower than the second latency.

### Claim 31 (depends on 21)

The method of claim 21, wherein the image processing system has a first latency with the first server and a second latency with the image store, the first latency being lower than the second latency.

### Claim 32 (depends on 21)

The method of claim 21, wherein processing the intermediate image to generate the first image includes:
processing, by the image processing system and based on a recipe provided by the client system, the intermediate image to generate the first image.

### Claim 33

A non-transitory computer-readable storage medium storing computer-readable instructions, comprising:
instructions for receiving, at an image processing system, a first request from a client system for serving a first image to a user device;
instructions for receiving, at the image processing system, an intermediate image from a first server, wherein the receiving includes:
instructions for transmitting, by the image processing system, a second request for response to each of multiple servers;
instructions for receiving, by the image processing system, a response from each server of a subset of the multiple servers for performing a task on a source image, the response including a corresponding score indicative of a match of corresponding server of the multiple servers to perform the task on the source image;
instructions for sending, by the image processing system, a message to the first server to perform the task;
instructions for processing, by the image processing system, the intermediate image to generate the first image; and
instructions for transmitting, by the image processing system, the first image to the client system for further transmission to the user device.

### Claim 34 (depends on 33)

The non-transitory computer-readable storage medium of claim 33, wherein the corresponding score of each corresponding server is determined as a function of latency between the corresponding server and an image store from which the corresponding server is to obtain the source image.

### Claim 35 (depends on 33)

The non-transitory computer-readable storage medium of claim 33, wherein the corresponding score is indicative of an amount of computing resources consumed by the corresponding server in performing the task.

### Claim 36 (depends on 33)

The non-transitory computer-readable storage medium of claim 33, wherein the corresponding score of each corresponding server is determined as an average of a load of the corresponding server and the latency of the server.

### Claim 37 (depends on 33)

The non-transitory computer-readable storage medium of claim 33, wherein the load of the corresponding server is determined as a function of a number of tasks being performed by the corresponding server and a file size of the source image on which the task is to be performed by the corresponding server.

### Claim 38 (depends on 33)

The non-transitory computer-readable storage medium of claim 33, wherein the first server includes a first score that satisfies a selection criterion, and wherein the first score is indicative of a first amount of computing resources consumed by the first server in performing the task, the first amount of computing resources being an amount of computing resources to be consumed by any of a remaining of the servers in performing the task.

### Claim 39

An apparatus comprising:
a processor;
a request receiving module configured to receive a first request from a client system for serving a first image to a user device;
a request dispatch module configured to transmit a second request for response to each of multiple servers;
a server determination module configured to receive a response from each server of a subset of the multiple servers for performing the task, the response including a corresponding score indicative of a match of a corresponding server of the multiple server to perform the task on the source image, wherein the request dispatch module is further configured to send a message to a first server to perform the task; and
an image processing module configured to:
receive an intermediate image from the first server,
process the intermediate image to generate the first image, and
transmit the first image to the client system for further transmission to the user device.

### Claim 40 (depends on 39)

The apparatus of claim 39, wherein the corresponding score of each corresponding server is determined as a function of latency between the corresponding server and an image store from which the corresponding server is to obtain the source image.

### Claim 41 (depends on 39)

The apparatus of claim 39, wherein the first server includes a first score that satisfies a selection criterion.

### Claim 42 (depends on 39)

The apparatus of claim 39, wherein the image processing system has a first latency with the first server and a second latency with the image store, the first latency being lower than the second latency.

### Claim 43 (depends on 39)

The apparatus of claim 39, wherein processing the intermediate image to generate the first image includes:
process the intermediate image to generate the first image, the context including attributes associated with the user device for which the first image is to be transmitted.

### Claim 44 (depends on 39)

The apparatus of claim 39, wherein the image processing module is further configured to:
process the intermediate image to generate multiple processed images based on multiple image processing instructions, the processed images being part of content associated with the client system, each of the processed images associated with a corresponding image processing instruction.

### Claim 45

A method comprising:
receiving, at an image processing system, a first request from a client system for serving a first image to a user device;
sending, by the image processing system, a message to the first server to perform a task on a source image;
receiving, at the image processing system, an intermediate image from a first server, the intermediate image comprising the performed task on the source image;
processing, by the image processing system, the intermediate image to generate the first image; and
transmitting, by the image processing system, the first image to the client system for further transmission to the user device.

### Claim 46 (depends on 45)

The method of claim 45, wherein the first server is selected based on a corresponding score of each corresponding server that is determined as a function of latency between the corresponding server and an image store from which the corresponding server is to obtain the source image.

### Claim 47 (depends on 45)

The method of claim 45, wherein the first server includes a first score that satisfies a selection criterion.

### Claim 48

A non-transitory computer-readable storage medium storing computer-readable instructions, comprising:
instructions for receiving, at an image processing system, a first request from a client system for serving a first image to a user device;
instructions for selecting, at the image processing system, a first server of multiple servers to perform a task and generate an intermediate image based on a corresponding score indicative of a match of each server of the multiple servers to perform the task on the source image;
instructions for sending, by the image processing system, a message to the first server to perform the task;
instructions for receiving, at the image processing system, the intermediate image from the first server;
instructions for processing, by the image processing system, the intermediate image to generate the first image; and
instructions for transmitting, by the image processing system, the first image to the client system for further transmission to the user device.
