# US 2020/0264764 A1 · Systems and Methods for Enabling Low-Vision Users to Interact with a Touch-Sensitive Secondary Display

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0264764 A1
- Document ID: US20200264764A1
- Status: Published application
- Kind: A1
- Application number: 16/869,489
- Filed: 2020-05-07
- Published: 2020-08-20
- Earliest claimed: 2016-10-25
- Assignees: Apple Inc.
- Applicants: Apple Inc.
- Inventors: Eric T. Seymour; Gregory F. Hughes; James P. Craig; Susumu Harada
- Web page: https://patentgrep.com/patent/US20200264764A1

## CPC

- G06F 3/04845: for image manipulation, e.g. dragging, rotation, expansion or change of colour
- G06F 1/1692: {the I/O peripheral being a secondary touch screen used as control interface, e.g. virtual buttons or sliders}
- G06F 3/0236: {using selection techniques to select from displayed items}
- G06F 3/0238: {Programmable keyboards (key guide holders G06F3/0224)}
- G06F 3/04847: Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
- G06F 3/04883: for inputting data by handwriting, e.g. gesture or text
- G06F 3/04886: by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
- G09B 21/008: {using visual presentation of the information for the partially sighted}
- G06F 2203/04806: Zoom, i.e. interaction techniques or interactors for controlling the zooming operation
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G09B: EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS (devices for psychotechnics or for testing reaction times A61B5/16; games, sports, amusements A63; projectors, projector screens G03B)

## Abstract

Disclosed herein are systems and methods that enable low-vision users to interact with touch-sensitive secondary displays. An example method includes, while operating a touch-sensitive secondary display in an accessibility mode: displaying, on the primary display, a first user interface for an application, and displaying, on the touch-sensitive secondary display, a second user interface that includes: (i) application-specific affordances, and (ii) a system-level affordance, where each application-specific affordance and the system-level affordance are displayed with a first display size. The method includes detecting an input at the application-specific affordance. In response to detecting the input, and while the input remains in contact: continuing to display the first user interface for the application; and displaying, on the primary display, a zoomed-in representation of the at least one application-specific affordance, where the zoomed-in representation of the application-specific affordance is displayed with a second display size that is larger than the first display size.

## Claims

### Claim 1

A method, comprising:
at a computing system comprising one or more processors, a first housing that includes a primary display, memory, and a second housing at least partially containing a touch-sensitive secondary display that is distinct from the primary display:
operating the touch-sensitive secondary display in an accessibility mode;
while operating the touch-sensitive secondary display in the accessibility mode:
displaying, on the primary display, a first user interface for an application;
displaying, on the touch-sensitive secondary display, a second user interface that includes: (i) a plurality of application-specific affordances that control functions available within the application and (ii) at least one system-level affordance that controls a system-level function, wherein each of the plurality of application-specific affordances and the at least one system-level affordance are displayed with a first display size;
detecting, via the touch-sensitive secondary display, an input that contacts at least one application-specific affordance of the plurality of application-specific affordances; and
in response to the detecting the input and while the input remains in contact with the touch-sensitive secondary display:
continuing to display, on the primary display, the first user interface for the application;
displaying, on the primary display, a zoomed-in representation of the at least one application-specific affordance, wherein the zoomed-in representation of the at least one application-specific affordance is displayed with a second display size that is larger than the first display size.

### Claim 2 (depends on 1)

The method of claim 1, wherein displaying the zoomed-in representation of the at least one application-specific affordance includes displaying the zoomed-in representation of the at least one application-specific affordance within a zoomed-in representation of the second user interface.

### Claim 3 (depends on 2)

The method of claim 2, wherein displaying the zoomed-in representation of the second user interface includes displaying a focus indicator within the zoomed-in representation of the second user interface that is positioned based at least in part on a position on the touch-sensitive secondary display at which the input contacted the touch-sensitive secondary display.

### Claim 4 (depends on 3)

The method of claim 3, wherein the focus indicator includes a representation of a countdown timer and the method includes:
in accordance with a determination that the input has remained in contact with the at least one application-specific affordance for more than a predetermined amount of time, updating the representation of the countdown timer to indicate that the countdown timer is active; and
in accordance with a determination that the countdown timer has expired, activating the at least one application-specific affordance.

### Claim 5 (depends on 4)

The method of claim 4, wherein:
the at least one application-specific affordance is associated with a slider, and
activating the at least one application-specific affordance includes updating the zoomed-in representation of the at least one application-specific affordance in accordance with movement of the at least one application-specific affordance along the slider.

### Claim 6 (depends on 1)

The method of claim 1, wherein the touch-sensitive secondary display includes a first area comprising the at least one application-specific affordance and a second area comprising other affordances distinct from the at least one application-specific affordance in the plurality of application-specific affordances, and the method further comprises:
while the input remains in contact with at least one application-specific affordance at the first area of the touch-sensitive secondary display, detecting a tap gesture at the second area of the touch-sensitive secondary display; and
in response to detecting the tap gesture, activating the at least one application-specific affordance.

### Claim 7 (depends on 1)

The method of claim 1, further comprising:
detecting, at the touch-sensitive secondary display, a predefined gesture that manipulates a zoom level that is used to display the zoomed-in representation of the at least one application-specific affordance at the primary display; and
in response to detecting the predefined gesture, updating the zoomed-in representation at the primary display as the zoom level is manipulated using the predefined gesture.

### Claim 8 (depends on 1)

The method of claim 1, wherein the zoomed-in representation of the at least one application-specific affordance is displayed on the primary display in accordance with a determination that the input has remained in continuous contact with the touch-sensitive secondary display for more than a predetermined amount of time.

### Claim 9 (depends on 1)

The method of claim 1, wherein each of the plurality of application-specific affordances and the at least one system-level affordance are selectable via one or more inputs at the touch-sensitive secondary display.

### Claim 10 (depends on 1)

The method of claim 1, wherein the second housing also at least partially contains a physical keyboard.

### Claim 11 (depends on 1)

The method of claim 1, wherein the second housing is not connected to the first housing.

### Claim 12 (depends on 1)

The method of claim 1, wherein the second housing is part of a wearable computing device.

### Claim 13

A non-transitory computer-readable storage medium storing executable instructions that, when executed by a computing system with one or more processors, a first housing that includes a primary display, and a second housing at least partially containing a touch-sensitive secondary display that is distinct from the primary display, cause the computing system to:
operate the touch-sensitive secondary display in an accessibility mode;
while operating the touch-sensitive secondary display in the accessibility mode:
display, on the primary display, a first user interface for an application;
display, on the touch-sensitive secondary display, a second user interface that includes: (i) a plurality of application-specific affordances that control functions available within the application and (ii) at least one system-level affordance that controls a system-level function, wherein each of the plurality of application-specific affordances and the at least one system-level affordance are displayed with a first display size;
detect, via the touch-sensitive secondary display, an input that contacts at least one application-specific affordance of the plurality of application-specific affordances; and
in response to the detecting the input and while the input remains in contact with the touch-sensitive secondary display:
continue to display, on the primary display, the first user interface for the application;
display, on the primary display, a zoomed-in representation of the at least one application-specific affordance, wherein the zoomed-in representation of the at least one application-specific affordance is displayed with a second display size that is larger than the first display size.

### Claim 14 (depends on 13)

The non-transitory computer-readable storage medium of claim 13, wherein displaying the zoomed-in representation of the at least one application-specific affordance includes displaying the zoomed-in representation of the at least one application-specific affordance within a zoomed-in representation of the second user interface.

### Claim 15 (depends on 14)

The non-transitory computer-readable storage medium of claim 14, wherein displaying the zoomed-in representation of the second user interface includes displaying a focus indicator within the zoomed-in representation of the second user interface that is positioned based at least in part on a position on the touch-sensitive secondary display at which the input contacted the touch-sensitive secondary display.

### Claim 16 (depends on 15)

The non-transitory computer-readable storage medium of claim 15, wherein the focus indicator includes a representation of a countdown timer and the executable instructions also cause the computing system to:
in accordance with a determination that the input has remained in contact with the at least one application-specific affordance for more than a predetermined amount of time, update the representation of the countdown timer to indicate that the countdown timer is active; and
in accordance with a determination that the countdown timer has expired, activate the at least one application-specific affordance.

### Claim 17

A computing system, comprising:
one or more processors;
a first housing that includes a primary display;
a second housing at least partially containing a touch-sensitive secondary display that is distinct from the primary display; and
memory storing one or more programs that are configured for execution by the one or more processors, the one or more programs including instructions for:
operating the touch-sensitive secondary display in an accessibility mode;
while operating the touch-sensitive secondary display in the accessibility mode:
displaying, on the primary display, a first user interface for an application;
displaying, on the touch-sensitive secondary display, a second user interface that includes: (i) a plurality of application-specific affordances that control functions available within the application and (ii) at least one system-level affordance that controls a system-level function, wherein each of the plurality of application-specific affordances and the at least one system-level affordance are displayed with a first display size;
detecting, via the touch-sensitive secondary display, an input that contacts at least one application-specific affordance of the plurality of application-specific affordances; and
in response to the detecting the input and while the input remains in contact with the touch-sensitive secondary display:
continuing to display, on the primary display, the first user interface for the application;
displaying, on the primary display, a zoomed-in representation of the at least one application-specific affordance, wherein the zoomed-in representation of the at least one application-specific affordance is displayed with a second display size that is larger than the first display size.

### Claim 18 (depends on 17)

The computing system of claim 17, wherein displaying the zoomed-in representation of the at least one application-specific affordance includes displaying the zoomed-in representation of the at least one application-specific affordance within a zoomed-in representation of the second user interface.

### Claim 19 (depends on 18)

The computing system of claim 18, wherein displaying the zoomed-in representation of the second user interface includes displaying a focus indicator within the zoomed-in representation of the second user interface that is positioned based at least in part on a position on the touch-sensitive secondary display at which the input contacted the touch-sensitive secondary display.

### Claim 20 (depends on 19)

The computing system of claim 19, wherein the focus indicator includes a representation of a countdown timer and the one or more programs also include instructions for:
in accordance with a determination that the input has remained in contact with the at least one application-specific affordance for more than a predetermined amount of time, updating the representation of the countdown timer to indicate that the countdown timer is active; and
in accordance with a determination that the countdown timer has expired, activating the at least one application-specific affordance.
