# US 2017/0364370 A1 · Tracking window position in a vdi environment

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2017/0364370 A1
- Document ID: US20170364370A1
- Status: Published application
- Kind: A1
- Application number: 15/183,203
- Filed: 2016-06-15
- Published: 2017-12-21
- Earliest claimed: 2016-06-15
- Assignees: VMware, Inc.
- Applicants: VMware, Inc.
- Inventors: Hari SIVARAMAN; Peter FARKAS
- Web page: https://patentgrep.com/patent/US20170364370A1

## CPC

- G06F 9/452: {Remote windowing, e.g. X-Window System, desktop virtualisation (protocols for virtual reality H04L67/131)}
- G06F 11/3006: {where the computing system is distributed, e.g. networked systems, clusters, multiprocessor systems (multiprogramming arrangements G06F9/46; allocation of resources G06F9/50)}
- G06F 11/3409: {for performance assessment}
- G06T 7/337: {involving reference images or patches}
- G06T 7/74: {involving reference images or patches}
- G06T 7/90: Determination of colour characteristics
- G06F 11/3438: {monitoring of user actions (tracking the activity of the user H04L67/535)}
- G06F 2201/865: Monitoring of software
- G06T 2207/10024: Color image
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

A method includes displaying a bitmap of unique groups of colored tiles on the display screen and reading a color value of a first pixel in a first tile in the bitmap. Color values of tiles within the first tile's group are determined. The position of the first pixel within the first tile is determined. The position of the first tile's group within the bitmap and the position of the first tile within the bitmap are also determined. The position of the first pixel in the bitmap and the position of the bitmap on the display screen are calculated. A performance metric is calculated based at least in part on the position of the bitmap on the display screen.

## Claims

### Claim 1

A method for tracking a window on a display screen, comprising:
displaying a bitmap on the display screen, wherein the bitmap comprises a plurality of unique groups of colored tiles, wherein each tile comprises one or more pixels and an associated color value, and wherein the unique groups are separated by a delimiter that also comprises an associated color value;
reading a color value of a first pixel in the bitmap;
if the color value of the first pixel matches a color value of a first tile within a group, determining the color values of each of the other tiles within the first tile's group;
determining the position of the first pixel within the first tile;
identifying the position of the first tile's group within the bitmap based on the color values of the tiles within the first tile's group;
identifying the position of the first tile within the bitmap using the position of the first tile within the first tile's group and the position of the first tile's group within the bitmap;
calculating the position of the first pixel in the bitmap based on the position of the first pixel within the first tile and the position of the first tile within the bitmap;
calculating the position of the bitmap on the display screen based on the position of the first pixel in the bitmap; and
calculating a performance metric based at least in part on the position of the bitmap on the display screen.

### Claim 2 (depends on 1)

The method of claim 1, further comprising:
if the color value of the first pixel matches the color value of the delimiter, performing one or more pixel movements across the bitmap by reading the color value of a pixel at a distance of a pre-determined number of pixels until a second pixel is located in a second tile of a different color value;
determining the color values of each of the other tiles within the second tile's group;
determining the position of the second pixel within the second tile;
identifying the position of the second tile's group within the bitmap based on the color values of the tiles within the second tile's group;
identifying the position of the second tile within the bitmap using the position of the second tile within the second tile's group and the position of the second tile's group within the bitmap;
calculating the position of the second pixel in the bitmap based on the position of the second pixel within the second tile and the position of the second tile within the bitmap; and
calculating the position of the first pixel in the bitmap based on the position of the second pixel in the bitmap.

### Claim 3 (depends on 1)

The method of claim 1, wherein determining the color values of each of the other tiles within the first tile's group comprises:
reading color values of pixels a predetermined number of pixels away from the first tile in one or more directions in the bitmap.

### Claim 4 (depends on 3)

The method of claim 3, wherein determining the color values of each of the other tiles within the first tile's group further determines the position of the first tile within the first tile's group.

### Claim 5 (depends on 1)

The method of claim 1, wherein the bitmap comprises three color values.

### Claim 6 (depends on 1)

The method of claim 1, wherein the performance metric comprises the evenness of movement of the bitmap on the display screen.

### Claim 7 (depends on 1)

The method of claim 1, wherein reading a color value of a first pixel in the bitmap comprises reading a color value at a predetermined observation point on the display screen.

### Claim 8

A non-transitory computer-readable storage medium containing a program which, when executed by one or more processors, performs operations for tracking a window on a display screen, the operations comprising:
displaying a bitmap on the display screen, wherein the bitmap comprises a plurality of unique groups of colored tiles, wherein each tile comprises one or more pixels and an associated color value, and wherein the unique groups are separated by a delimiter that also comprises an associated color value;
reading a color value of a first pixel in the bitmap;
if the color value of the first pixel matches a color value of a first tile within a group, determining the color values of each of the other tiles within the first tile's group;
determining the position of the first pixel within the first tile;
identifying the position of the first tile's group within the bitmap based on the color value of the tiles within the first tile's group;
identifying the position of the first tile within the bitmap using the position of the first tile within the first tile's group and the position of the first tile's group within the bitmap;
calculating the position of the first pixel in the bitmap based on the position of the first pixel within the first tile and the position of the first tile within the bitmap;
calculating the position of the bitmap on the display screen based on the position of the first pixel in the bitmap; and
calculating a performance metric based at least in part on the position of the bitmap on the display screen.

### Claim 9 (depends on 8)

The computer-readable storage medium of claim 8, further comprising:
if the color value of the first pixel matches the color value of the delimiter, performing one or more pixel movements across the bitmap by reading the color value of a pixel at a distance of a pre-determined number of pixels until a second pixel is located in a second tile of a different color value;
determining the color values of each of the other tiles within the second tile's group;
determining the position of the second pixel within the second tile;
identifying the position of the second tile's group within the bitmap based on the color values of the tiles within the second tile's group;
identifying the position of the second tile within the bitmap using the position of the second tile within the second tile's group and the position of the second tile's group within the bitmap;
calculating the position of the second pixel in the bitmap based on the position of the second pixel within the second tile and the position of the second tile within the bitmap; and
calculating the position of the first pixel in the bitmap based on the position of the second pixel in the bitmap.

### Claim 10 (depends on 8)

The computer-readable storage medium of claim 8, wherein determining the color values of each of the other tiles within the first tile's group comprises:
reading color values of pixels a predetermined number of pixels away from the first tile in one or more directions in the bitmap.

### Claim 11 (depends on 10)

The computer-readable storage medium of claim 10, wherein determining the color values of each of the other tiles within the first tile's group further determines the position of the first tile within the first tile's group.

### Claim 12 (depends on 8)

The computer-readable storage medium of claim 8, wherein the bitmap comprises three color values.

### Claim 13 (depends on 8)

The computer-readable storage medium of claim 8, wherein the performance metric comprises the evenness of movement of the bitmap on the display screen.

### Claim 14 (depends on 8)

The computer-readable storage medium of claim 8, wherein reading a color value of a first pixel in the bitmap comprises reading a color value at a predetermined observation point on the display screen.

### Claim 15

A system, comprising:
a processor; and
a memory, wherein the memory includes a program executable in the processor to perform operations for tracking a window on a display screen, the operations comprising:
displaying a bitmap on the display screen, wherein the bitmap comprises a plurality of unique groups of colored tiles, wherein each tile comprises one or more pixels and an associated color value, and wherein the unique groups are separated by a delimiter that also comprises an associated color value;
reading a color value of a first pixel in the bitmap;
if the color value of the first pixel matches a color value of a first tile within a group, determining the color values of each of the other tiles within the first tile's group;
determining the position of the first pixel within the first tile;
identifying the position of the first tile's group within the bitmap based on the color values of the tiles within the first tile's group;
identifying the position of the first tile within the bitmap using the position of the first tile within the first tile's group and the position of the first tile's group within the bitmap;
calculating the position of the first pixel in the bitmap based on the position of the first pixel within the first tile and the position of the first tile within the bitmap;
calculating the position of the bitmap on the display screen based on the position of the first pixel in the bitmap; and
calculating a performance metric based at least in part on the position of the bitmap on the display screen.

### Claim 16 (depends on 15)

The system of claim 15, the operations further comprising:
if the color value of the first pixel matches the color value of the delimiter, performing one or more pixel movements across the bitmap by reading the color value of a pixel at a distance of a pre-determined number of pixels until a second pixel is located in a second tile of a different color value;
determining the color values of each of the other tiles within the second tile's group;
determining the position of the second pixel within the second tile;
identifying the position of the second tile's group within the bitmap based on the color value of the tiles within the second tile's group;
identifying the position of the second tile within the bitmap using the position of the second tile within the second tile's group and the position of the second tile's group within the bitmap;
calculating the position of the second pixel in the bitmap based on the position of the second pixel within the second tile and the position of the second tile within the bitmap; and
calculating the position of the first pixel in the bitmap based on the position of the second pixel in the bitmap.

### Claim 17 (depends on 15)

The system of claim 15, wherein determining the color values of each of the other tiles within the first tile's group comprises:
reading color values of pixels a predetermined number of pixels away from the first tile in one or more directions in the bitmap.

### Claim 18 (depends on 17)

The system of claim 17, wherein determining the color values of each of the other tiles within the first tile's group further determines the position of the first tile within the first tile's group.

### Claim 19 (depends on 15)

The system of claim 15, wherein the bitmap comprises three color values.

### Claim 20 (depends on 15)

The system of claim 15, wherein the performance metric comprises the evenness of movement of the bitmap on the display screen.
