# US 2014/0152584 A1 · System and method for objectively measuring user experience of touch screen based devices

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2014/0152584 A1
- Document ID: US20140152584A1
- Status: Published application
- Kind: A1
- Application number: 13/692,154
- Filed: 2012-12-03
- Published: 2014-06-05
- Earliest claimed: 2012-12-03
- Assignees: Apkudo, LLC
- Applicants: Apkudo, LLC
- Inventors: Joshua Scott Matthews; David Michael Teitelbaum; Benjamin Kou-An Tseng
- Web page: https://patentgrep.com/patent/US20140152584A1

## CPC

- G06F 3/041: Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
- G06F 11/2221: {to test input/output devices or peripheral units}
- G06F 11/3041: {where the computing system component is an input/output interface (interconnection of, or transfer of information or other signals between, memories, input/output devices or central processing units G06F13/00)}
- G06F 11/3419: {by assessing time}
- Y10S 901/14: Arm movement, spatial
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- Y10S: TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS

## Abstract

One aspect of the invention relates to an exemplary method for measuring latency of display response of a touch screen on a touch screen based device, comprising recording, by a video camera, an interaction with the touch screen, correlating, by a processor in operative communication with the video camera, data retrieved from the recording to the interaction; and determining, by the processor, a latency of the response of the touch screen to the first contact. An interaction may comprise at least a first contact between a member and the touch screen, and a response of the touch screen to the first contact, including at least a first change of a frame of a display of the touch screen.

## Claims

### Claim 1

A method of measuring latency of display response of a touch screen on a touch screen based device, comprising:
recording, by a video camera, an interaction with the touch screen, the interaction comprising:
at least a first contact between a member and the touch screen; and
a response of the touch screen to the first contact including at least a first change of a frame of a display of the touch screen;
correlating, by a processor in operative communication with the video camera, data retrieved from the recording to the interaction;
determining, by the processor, a latency of the response of the touch screen to the first contact.

### Claim 2 (depends on 1)

The method of claim 1, wherein the first contact comprises at least a first type of contact between the member and the touch screen, the first type of contact including:
an initial contact between the member and the touch screen; and
a completion of the first type of contact between the member and the touch screen.

### Claim 3 (depends on 1)

The method of claim 1, wherein the interaction comprises a plurality of contacts between the member and the touch screen, including at least the first contact of a first type and a second contact of a second type different from the first type of contact, with one or more of the plurality of contacts including:
an initial contact between the member and the touch screen; and
a completion of the contact between the member and the touch screen.

### Claim 4 (depends on 3)

The method of claim 3, wherein the plurality of contacts comprises at least a plurality of contacts of the first type of contact and a plurality of contacts of the second type of contact.

### Claim 5 (depends on 3)

The method of claim 3, further comprising:
correlating, by the processor, data retrieved from the recording for one or more of the plurality of contacts of a specific type to the interaction; and
determining, by the processor, an average latency of response of the touch screen to a contact of the specific type.

### Claim 6 (depends on 1)

The method of claim 1, comprising:
storing the correlated data in a storage;
wherein determining a latency of the response of the touch screen to the first contact includes:
accessing the storage for data corresponding to one or more interactions including a contact of a same type as the first contact;
aggregating the accessed data and the correlated data;
computing an average latency of response of the touch screen to the first contact based on the aggregated data.

### Claim 7 (depends on 1)

The method of claim 1, wherein the response of the touch screen to the contact comprises:
an initial response of the touch screen including at least the first change of the frame of the touch screen display; and
a completion of the response of the touch screen including at least a plurality of frame changes.

### Claim 8 (depends on 1)

The method of claim 1, wherein the camera has a recording rate of at least a 60 frames-per-second.

### Claim 9 (depends on 2)

The method of claim 2, wherein a type of contact may comprise one of a touch, a swipe or a button press.

### Claim 10 (depends on 1)

The method of claim 1, wherein determining the latency of the response of the touch screen to the first contact comprises determining a frames-per-second rate of the touch screen response.

### Claim 11 (depends on 10)

The method of claim 10, wherein determining the latency of the response of the touch screen to the first contact comprises measuring a consistency of the frames-per-second rate of the touch screen response during a time period of the touch screen response to the first contact.

### Claim 12 (depends on 1)

The method of claim 1, wherein the member comprises a robotic member coupled to the processor, the method further comprising:
moving the robotic member to effectuate an interaction with the touch screen based device.

### Claim 13

A video camera for measuring latency of display response of a touch screen on a touch screen based device, comprising:
a recorder configured to record one or more interactions, an interaction comprising:
at least a first contact between a member and the touch screen; and
a response of the touch screen to the first contact, the response including at least a first change of a frame of a display of the touch screen;
a processor configured to:
correlate data retrieved from the recording to the interaction; and
determine a latency of the response of the touch screen to the first contact.

### Claim 14 (depends on 13)

The camera of claim 13, wherein the first contact comprises at least a first type of contact between the member and the touch screen, the first type of contact including:
an initial contact between the member and the touch screen; and
a completion of the first type of contact between the member and the touch screen.

### Claim 15 (depends on 13)

The camera of claim 13, wherein the interaction comprises a plurality of contacts between the member and the touch screen, including at least the first contact of a first type and a second contact of a second type different from the first type of contact, with one or more of the plurality of contacts including:
an initial contact between the member and the touch screen; and
a completion of the contact between the member and the touch screen.

### Claim 16 (depends on 16)

The camera of claim 16 wherein the plurality of contacts comprises at least a plurality of contacts of the first type of contact and a plurality of contacts of the second type of contact.

### Claim 17 (depends on 16)

The camera of claim 16, further comprising:
storage configured to store the recording of the one or more interactions;
wherein the processor is further configured to:
correlate data retrieved from the storage for one or more of the plurality of contacts of a specific type to the interaction; and
determine an average latency of response of the touch screen to a contact of the specific type.

### Claim 18 (depends on 13)

The camera of claim 13, comprising:
storage configured to store the recording of the one or more interactions;
wherein the processor is configured to determine the latency of the response of the touch screen to the first contact by:
accessing the storage for data corresponding to one or more interactions including a contact of a same type as the first contact;
aggregating the accessed data and the correlated data;
computing an average latency of response of the touch screen to the first contact based on the aggregated data.

### Claim 19 (depends on 13)

The camera of claim 13, wherein the response of the touch screen to the first contact comprises:
an initial response of the touch screen including at least the first change of the frame of the touch screen display; and
a completion of the response of the touch screen including at least a plurality of frame changes.

### Claim 20 (depends on 13)

The camera of claim 13, wherein the camera has a recording rate of at least a 60 frames-per-second.

### Claim 21 (depends on 14)

The camera of claim 14, wherein a type of contact may comprise one of a touch, a swipe or a button press.

### Claim 22 (depends on 13)

The camera of claim 13, wherein the processor is configured to determine the latency of the response of the touch screen to the first contact by determining a frames-per-second rate of the touch screen response.

### Claim 23 (depends on 22)

The camera of claim 22, wherein the processor is configured to determine the latency of the response of the touch screen to the contact by measuring a consistency of the frames-per-second rate of the touch screen response during a time period of the touch screen response to the first contact.

### Claim 24 (depends on 13)

The camera of claim 13, wherein the member comprises a robotic member coupled to the processor, the robotic member configured to move to effectuate an interaction with the touch screen based device.

### Claim 25

A system for measuring latency of display response of a touch screen on a touch screen based device, comprising:
a housing;
a holder coupled to the housing, the holder configured to hold the touch screen based device in a fixed position;
a robotic member coupled to the housing, the robotic member configured to effect one or more interactions with the touch screen based device; and
a video camera coupled to the housing, the video camera comprising:
a lens, the lens being positioned such that it views the holder for the touch screen based device;
a recorder configured to:
record an interaction with the touch screen, the interaction comprising:
at least a first contact between the robotic member and the touch screen; and
a response of the touch screen to the first contact including at least a first change of a frame of a display of the touch screen; and
a processor in operative communication with the video camera, the processor configured to:
correlate data retrieved from the recording to the interaction; and
determine a latency of the response of the touch screen to the first contact.

### Claim 26 (depends on 25)

The system of claim 25, wherein the first contact comprises at least a first type of contact between the member and the touch screen, the first type of contact including:
an initial contact between the member and the touch screen; and
a completion of the first type of contact between the member and the touch screen.

### Claim 27 (depends on 25)

The system of claim 25, wherein the interaction comprises a plurality of contacts between the member and the touch screen, including at least the first contact of a first type and a second contact of a second type different from the first type of contact, with one or more of the plurality of contacts including:
an initial contact between the member and the touch screen; and
a completion of the contact between the member and the touch screen.

### Claim 28 (depends on 28)

The system of claim 28, wherein the plurality of contacts comprises at least a plurality of contacts of the first type of contact and a plurality of contacts of the second type of contact.

### Claim 29 (depends on 28)

The system of claim 28, further comprising:
storage configured to store the recording of the one or more interactions;
wherein the processor is further configured to:
correlate data retrieved from the storage for one or more of the plurality of contacts of a specific type to the interaction; and
determine an average latency of response of the touch screen to a contact of the specific type.

### Claim 30 (depends on 25)

The system of claim 25, further comprising:
storage configured to store the recording of the one or more interactions;
wherein the processor is configured to determine the latency of the response of the touch screen to the first contact by:
accessing the storage for data corresponding to one or more interactions including a contact of a same type as the first contact;
aggregating the accessed data and the correlated data;
computing an average latency of response of the touch screen to the first contact based on the aggregated data.

### Claim 31 (depends on 25)

The system of claim 25, wherein the response of the touch screen to the contact comprises:
an initial response of the touch screen including at least the first change of the frame of the touch screen display; and
a completion of the response of the touch screen including at least a plurality of frame changes.

### Claim 32 (depends on 25)

The system of claim 25, wherein the camera has a recording rate of at least a 60 frames-per-second.

### Claim 33 (depends on 26)

The system of claim 26, wherein a type of contact may comprise one of a touch, a swipe or a button press.

### Claim 34 (depends on 25)

The system of claim 25, wherein the processor is configured to determine the latency of the response of the touch screen to the first contact by determining a frames-per-second rate of the touch screen response.

### Claim 35 (depends on 34)

The system of claim 34, wherein the processor is configured to determine the latency of the response of the touch screen to the first contact by measuring a consistency of the frames-per-second rate of the touch screen response during a time period of the touch screen response to the first contact.

### Claim 36 (depends on 25)

The system of claim 25, further comprising an actuator coupled to the robotic member, the actuator configured to effect movement of the robotic member.

### Claim 37

A method of measuring a response rate of a touch screen on a touch screen based device, comprising:
recording, by a video camera, an interaction with the touch screen, the interaction comprising:
at least a first contact between a member and the touch screen; and
a response of the touch screen to the first contact including at least a first change of a frame of a display of the touch screen;
correlating, by a processor in operative communication with the video camera, data retrieved from the recording to the interaction;
determining, by the processor, a frames-per-second rate of the response of the touch screen during a time period of the touch screen response to the first contact.

### Claim 38

A video camera for measuring a response rate of a touch screen on a touch screen based device, comprising:
a recorder configured to record one or more interactions, an interaction comprising:
at least a first contact between a member and the touch screen; and
a response of the touch screen to the first contact, the response including at least a first change of a frame of a display of the touch screen;
a processor configured to:
correlate data retrieved from the recording to the interaction; and
determine a frames-per-second rate of the response of the touch screen during a time period of the touch screen response to the first contact.

### Claim 39

A system for measuring a response rate of a touch screen on a touch screen based device, comprising:
a housing;
a holder coupled to the housing, the holder configured to hold the touch screen based device in a fixed position;
a robotic member coupled to the housing, the robotic member configured to effect one or more interactions with the touch screen based device; and
a video camera coupled to the housing, the video camera comprising a lens and a recorder, the lens being positioned such that it views the holder for the touch screen based device, the video camera configured to:
record an interaction with the touch screen, the interaction comprising:
at least a first contact between the robotic member and the touch screen; and
a response of the touch screen to the first touch including at least a first change of a frame of a display of the touch screen; and
a processor in operative communication with the video camera, the processor configured to:
correlate data retrieved from the recording to the interaction; and
determine a frames-per-second rate of the response of the touch screen during a time period of the touch screen response to the first contact.