# US 2025/0149038 A1 · Digital assistant for providing handsfree notification management

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0149038 A1
- Document ID: US20250149038A1
- Status: Published application
- Kind: A1
- Application number: 19/014,033
- Filed: 2025-01-08
- Published: 2025-05-08
- Earliest claimed: 2021-09-24
- Assignees: Apple Inc.
- Applicants: Apple Inc.
- Inventors: Andrea Valentina SIMES; Daniel W. LOO; Felicia W. EDWARDS; Harry M. SIMMONDS; Tyler R. CALDERONE; Kevin D. PITOLIN; Lorena S. PAZMINO
- Web page: https://patentgrep.com/patent/US20250149038A1

## CPC

- G10L 15/22: Procedures used during a speech recognition process, e.g. man-machine dialogue
- G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)}
- G06F 3/038: Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
- G06F 3/0481: based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F 3/0482: Interaction with lists of selectable items, e.g. menus
- G06F 3/04883: for inputting data by handwriting, e.g. gesture or text
- G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback}
- G06F 40/216: using statistical methods
- G06F 40/247: Thesauruses; Synonyms
- G06F 40/30: Semantic analysis
- G06F 40/35: Discourse or dialogue representation
- G06Q 10/10: Office automation; Time management
- H04M 1/72469: for operating the device by selecting functions from two or more displayed items, e.g. menus or icons
- G06F 2203/0381: Multimodal input, i.e. interface arrangements enabling the user to issue commands by simultaneous use of input devices of different nature, e.g. voice plus gesture on digitizer
- G10L 2015/223: {Execution procedure of a spoken command}
- G10L 2015/228: {of application context}
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- H04M: TELEPHONIC COMMUNICATION (circuits for controlling other apparatus via a telephone cable and not involving telephone switching apparatus G08)

## Abstract

This relates generally to intelligent automated assistants and, more specifically, to provide a handsfree notification management system. An example method includes displaying one or more notifications by the electronic device. In response to displaying the one or more notifications, the method includes detecting a visual interaction of a user with the one or more notifications, identifying a notification from the one or more notifications based on the visual interaction, determining a time-interval of the visual interaction with the notification, determining one or more actions associated with the notification based on the time-interval of the visual interaction with the notification, and performing the one or more actions.

## Claims

### Claim 1

An electronic device comprising:
one or more processors;
a memory; and
one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for:
displaying one or more notifications by the electronic device;
in response to displaying the one or more notifications:
detecting a visual interaction of a user with the one or more notifications;
identifying a notification from the one or more notifications based on the visual interaction;
determining a time-interval of the visual interaction with the notification;
determining one or more actions associated with the notification based on the time-interval of the visual interaction with the notification; and
performing the one or more actions.

### Claim 2 (depends on 1)

The electronic device of claim 1, wherein determining the one or more actions associated with the notification is further based on determining that the time-interval exceeds at least one predetermined threshold, and wherein the one or more programs further include instructions for:
in response to identifying the notification from the one or more notifications based on the visual interaction:
determining that the time-interval exceeds at least one predetermined threshold.

### Claim 3 (depends on 1)

The electronic device of claim 1, wherein each of the one or more notifications is an alert of an event associated with the electronic device.

### Claim 4 (depends on 1)

The electronic device of claim 1, wherein detecting the visual interaction of the user with the one or more notifications is based on a gaze direction of the user's eyes.

### Claim 5 (depends on 1)

The electronic device of claim 1, wherein identifying a notification from the one or more notifications based on the visual interaction comprises:
determining a gaze direction of the user directed at the one or more notifications;
determining a time-interval of the gazing direction of the user; and
selecting the notification from the one or more notifications based on the time-interval of the gazing direction of the user.

### Claim 6 (depends on 1)

The method of claim 1, wherein performing the one or more actions comprises:
determining whether the one or more actions are associated with a notification system or an application associated with the notification; and
in response to determining that the one or more actions are associated with the notification system:
invoking the notification system to perform the one or more actions based on determining that the one or more action is associated with the notification of the notification system.

### Claim 7 (depends on 6)

The electronic device of claim 6, wherein the one or more programs further include instructions for:
in response to determining that the one or more actions are associated with the notification system:
determining that the one or more actions are associated with manipulating one or more user interface elements of the notification; and
manipulating the one or more user interface elements to perform the one or more actions.

### Claim 8 (depends on 6)

The electronic device of claim 6, wherein performing the one or more actions comprises:
in response to determining that the one or more actions are associated with the application:
invoking the application to perform the one or more actions based on determining that the one or more action is associated with the notification of the notification system.

### Claim 9 (depends on 8)

The electronic device of claim 8, further comprising:
in response to determining that the one or more actions are associated with the application:
identifying an entity associated with the notification; and
invoking the application to perform the one or more actions involving the entity to change a state of the entity associated with the notification of the notification system.

### Claim 10 (depends on 9)

The electronic device of claim 9, wherein the one or more notifications are displayed on a portion of a user interface of the electronic device.

### Claim 11

A non-transitory computer-readable storage medium storing
one or more programs, the one or more programs including instructions, which when executed by one or more processors of an electronic device, cause the electronic device to:
display one or more notifications by the electronic device;
in response to displaying the one or more notifications:
detect a visual interaction of a user with the one or more notifications;
identify a notification from the one or more notifications based on the visual interaction;
determine a time-interval of the visual interaction with the notification;
determine one or more actions associated with the notification based on the time-interval of the visual interaction with the notification; and
perform the one or more actions.

### Claim 12

A method performed on an electronic device, the method comprising:
displaying one or more notifications by the electronic device;
in response to displaying the one or more notifications:
detecting a visual interaction of a user with the one or more notifications;
identifying a notification from the one or more notifications based on the visual interaction;
determining a time-interval of the visual interaction with the notification;
determining one or more actions associated with the notification based on the time-interval of the visual interaction with the notification; and
performing the one or more actions.
