# US 2024/0004538 A1 · Out-of-process hit-testing for electronic devices

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0004538 A1
- Document ID: US20240004538A1
- Status: Published application
- Kind: A1
- Application number: 18/217,498
- Filed: 2023-06-30
- Published: 2024-01-04
- Earliest claimed: 2022-07-01
- Assignees: Apple Inc.
- Applicants: Apple Inc.
- Inventors: Mark A. EBBOLE; Andrew T. FINKE; Abhinay ASHUTOSH
- Web page: https://patentgrep.com/patent/US20240004538A1

## CPC

- G06F 3/04847: Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
- G06F 3/0481: based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F 3/04815: Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object
- G06F 3/04842: Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence)
- G06F 3/0488: using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

Out-of-process hit-testing can provide increased privacy and efficiency in computer user input systems. In an aspect, an application specifies a control style for a UI window to be managed separately from the application, such as by a system process running outside of the application process. When a user input is received at a location corresponding to a part of the application UI that is separate from the UI window for which the control style has been specified, the user input may be redirected to the UI window for which the control style has been specified.

## Claims

### Claim 1

A method, comprising:
receiving, at a system process of an electronic device from an application running on the electronic device, a definition of a control style for a first user interface window of a user interface (UI) managed by the application;
receiving, by the system process while the first user interface window and a second user interface window managed by the application are displayed by the electronic device, a user input at a location associated with the second UI window; and
redirecting, by the system process and based on the definition of the control style, the user input at the location associated with the second UI window to the first UI window.

### Claim 2 (depends on 1)

The method of claim 1, further comprising:
receiving an other user input at the location associated with the second UI window while the second UI window is displayed and the first UI window is not displayed; and
providing the other user input to the second UI window.

### Claim 3 (depends on 1)

The method of claim 1, further comprising:
receiving an other user input at the location associated with the second UI window while the second UI window is displayed and the first UI window is not displayed; and
generating, by the system process responsive to the other user input at the location associated with the second UI window while the second UI window is displayed and the first UI window is not displayed, a visual or audio effect for an element of the second UI window, the visual or audio effect based on another definition previously provided to the system process by the application.

### Claim 4 (depends on 3)

The method of claim 3, further comprising, while the first user interface window and the second user interface window managed by the application are displayed by the electronic device, abstaining from providing the visual or audio effect for the element of the second UI window responsive to the user input received at the location associated with the second UI window.

### Claim 5 (depends on 1)

The method of claim 1, wherein the first user interface window is displayed to appear at least partially in front of the second user interface window.

### Claim 6 (depends on 1)

The method of claim 1, wherein the first user interface window is spatially separated from the second user interface window.

### Claim 7 (depends on 1)

The method of claim 1, wherein the first user interface window and the second user interface window are displayed to appear at first and second respective locations that are remote from the electronic device, and wherein the second respective location of the second user interface window is closer to the electronic device than the first respective location of the first user interface window.

### Claim 8 (depends on 1)

The method of claim 1, further comprising, responsive to receiving the redirected user input by the first user interface window, closing the first user interface window.

### Claim 9 (depends on 1)

The method of claim 1, further comprising, responsive to receiving the redirected user input by the first user interface window, ignoring the user input.

### Claim 10 (depends on 1)

The method of claim 1, further comprising:
receiving, by the system process while the first user interface window and the second user interface window managed by the application are displayed by the electronic device, an other user input at an other location unassociated with the first user interface window or the second user interface window; and
abstaining from providing the other user input to the application.

### Claim 11

A non-transitory computer readable medium storing instructions that, when executed by one or more processors, cause the one or more processors to perform operations comprising:
receiving, at a system process of an electronic device from an application running on the electronic device, a definition of a control style for a first user interface window of a user interface (UI) managed by the application;
receiving, by the system process while the first user interface window and a second user interface window managed by the application are displayed by the electronic device, a user input at a location associated with the second UI window; and
redirecting, by the system process and based on the definition of the control style, the user input at the location associated with the second UI window to the first UI window.

### Claim 12 (depends on 11)

The non-transitory computer readable medium of claim 11, the operations further comprising:
receiving an other user input at the location associated with the second UI window while the second UI window is displayed and the first UI window is not displayed; and
providing the user input to the second UI window.

### Claim 13 (depends on 11)

The non-transitory computer readable medium of claim 11, the operations further comprising:
receiving an other user input at the location associated with the second UI window while the second UI window is displayed and the first UI window is not displayed; and
generating, by the system process responsive to the user input at the location associated with the second UI window while the second UI window is displayed and the first UI window is not displayed, a visual or audio effect for an element of the second UI window, the visual or audio effect based on another definition previously provided to the system process by the application.

### Claim 14 (depends on 13)

The non-transitory computer readable medium of claim 13, the operations further comprising, while the first user interface window and the second user interface window managed by the application are displayed by the electronic device, abstaining from providing the visual or audio effect for the element of the second UI window responsive to the user input received at the location associated with the second UI window.

### Claim 15 (depends on 11)

The non-transitory computer readable medium of claim 11, wherein the first user interface window is displayed to appear at least partially in front of the second user interface window.

### Claim 16 (depends on 11)

The non-transitory computer readable medium of claim 11, wherein the first user interface window is spatially separated from the second user interface window.

### Claim 17 (depends on 11)

The non-transitory computer readable medium of claim 11, wherein the first user interface window and the second user interface window are displayed to appear at first and second respective locations that are remote from the electronic device, and wherein the second respective location of the second user interface window is closer to the electronic device than the first respective location of the first user interface window.

### Claim 18 (depends on 11)

The non-transitory computer readable medium of claim 11, the operations further comprising, responsive to receiving the redirected user input by the first user interface window, closing the first user interface window or ignoring the user input.

### Claim 19

An electronic device, comprising:
a memory; and
one or more processors configured to:
receive, at a system process of the electronic device from an application running on the electronic device, a definition of a control style for a first user interface window of a user interface (UI) managed by the application;
receive, by the system process while the first user interface window and a second user interface window managed by the application are displayed by the electronic device, a user input at a location associated with the second UI window; and
redirect, by the system process and based on the definition of the control style, the user input at the location associated with the second UI window to the first UI window.

### Claim 20 (depends on 19)

The electronic device of claim 19, wherein redirecting the user input at the location associated with the second UI window to the first UI window comprises providing, by the system process, an indication of the user input in association with a different location, the different location corresponding to the first UI window.
