# US 2020/0396305 A1 · Method and system for providing actionable notification to a user of an augmented reality device

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0396305 A1
- Document ID: US20200396305A1
- Status: Published application
- Kind: A1
- Application number: 16/704,766
- Filed: 2019-12-05
- Published: 2020-12-17
- Earliest claimed: 2019-06-12
- Assignees: Samsung Electronics Co., Ltd.
- Applicants: Samsung Electronics Co., Ltd.
- Inventors: Naresh Kumar GUPTA
- Web page: https://patentgrep.com/patent/US20200396305A1

## CPC

- H04L 67/55: Push-based network services
- G06F 1/163: {Wearable computers, e.g. on a belt}
- G06F 1/1686: {the I/O peripheral being an integrated camera}
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06F 3/0304: {Detection arrangements using opto-electronic means (constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042)}
- G06F 3/04817: using icons (graphical or visual programming using iconic symbols G06F8/34)
- G06F 3/0482: Interaction with lists of selectable items, e.g. menus
- G06F 3/04842: Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence)
- G06F 3/0488: using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- H04L 51/04: Real-time or near real-time messaging, e.g. instant messaging [IM]
- H04L 51/224: providing notification on incoming messages, e.g. pushed notifications of received messages
- H04L 67/131: Protocols for games, networked simulations or virtual reality
- H04L 67/306: User profiles
- H04L 67/75: Indicating network or usage conditions on the user display
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

An apparatus is provided. The apparatus includes a display; and at least one processor coupled to the display and configured to determine information concerning at least one object in a field of view of the apparatus, determine a relationship between the at least one object and a user of the apparatus, determine at least one notification concerning the at least one object based on the information and the relationship, wherein the at least one notification is displayed on the display, determine a user interface (UI) including at least one task based on the at least one notification, wherein the UI is displayed on the display, and perform the at least one task when the at least one task on the UI is selected.

## Claims

### Claim 1

An apparatus, comprising:
a display; and
at least one processor coupled to the display and configured to:
determine information concerning at least one object in a field of view of the apparatus,
determine a relationship between the at least one object and a user of the apparatus,
determine at least one notification concerning the at least one object based on the information and the relationship, wherein the at least one notification is displayed on the display,
determine a user interface (UI) including at least one task based on the at least one notification, wherein the UI is displayed on the display, and
perform the at least one task when the at least one task on the UI is selected.

### Claim 2 (depends on 1)

The apparatus of claim 1, wherein the at least one processor comprises:
an object identifier configured to identify the at least one object;
an object information determiner configured to determine the information concerning the at least one object;
an object relationship determiner configured to determine whether the user is a user of the at least one object; and
a personalized notification generator configured to determine the at least one notification and the UI including the at the least one task.

### Claim 3 (depends on 2)

The apparatus of claim 2, wherein the object identifier is further configured to store an identifier and a status for each identified object.

### Claim 4 (depends on 2)

The apparatus of claim 2, wherein the object information determiner is further configured to store an identifier for each identified object and an identifier of the user.

### Claim 5 (depends on 2)

The apparatus of claim 2, wherein the object relationship determiner is further configured to store an identifier for each identified object, an authentication parameter for each identified object, a relationship between each identified object and the user, and a location of each identified object with respect to the user.

### Claim 6 (depends on 2)

The apparatus of claim 2, wherein the personalized notification generator is further configured to store an identifier for each identified object; at least one first type of notification associated with each identified object, respectively, concerning the user; and at least one second type of notification associated with each identified object, respectively, concerning the user.

### Claim 7 (depends on 2)

The apparatus of claim 2, wherein the personalized notification generator comprises:
an information aggregator configured to collect and aggregate information from a plurality of sources corresponding to the user;
an information sanitizer coupled to the information aggregator and configured to remove redundancy from the collected information and identify an omission in the collected information;
an information extractor coupled to the information sanitizer and configured to identify and store relevant information from a message;
an information priority identifier coupled to the information sanitizer and configured to prioritize information based on context and content;
a notification generator coupled to the information extractor and the information priority identifier and configured to generate a notification for the user; and
a storage device coupled to the notification generator and configured to store a personalized notification and a priority of the personalized notification.

### Claim 8 (depends on 7)

The apparatus of claim 7, wherein the plurality of sources corresponding to the user comprises at least one of an electronic mail, a short message service message, and an application.

### Claim 9 (depends on 1)

The apparatus of claim 1, wherein the at least one processor is further configured to performing the at least one task when the at least one task on the UI is selected and the task is available to be performed.

### Claim 10 (depends on 1)

The apparatus of claim 1, further comprising:
a memory coupled to the at least one processor and configured to store the information;
a processor coupled to the memory and configured to perform various functions; and
a communication device coupled to the processor and configured to establish a communication with an external device.

### Claim 11

A method of an apparatus, comprising:
determining information concerning at least one object in a field of view of the apparatus;
determining a relationship between the at least one object and a user of the apparatus;
determining at least one notification concerning the at least one object based on the information and the relationship, wherein the at least one notification is displayed on a display;
determining a user interface (UI) including at least one task based on the at least one notification, wherein the UI is displayed on the display, and
performing the at least one task when the at least one task on the UI is selected.

### Claim 12 (depends on 11)

The method of claim 11, further comprising:
identifying the at least one object;
determining the information concerning the at least one object;
determining whether the user is a user of the at least one object; and
determining the at least one notification and the UI including the at the least one task.

### Claim 13 (depends on 12)

The method of claim 12, further comprising storing, by the object identifier, an identifier and a status for each identified object.

### Claim 14 (depends on 12)

The method of claim 12, further comprising storing, by the object information determiner, an identifier for each identified object and an identifier of the user.

### Claim 15 (depends on 12)

The method of claim 12, further comprising storing, by the object relationship determiner, an identifier for each identified object, an authentication parameter for each identified object, a relationship between each identified object and the user, and a location of each identified object with respect to the user.

### Claim 16 (depends on 12)

The method of claim 12, further comprising storing, by the personalized notification generator, an identifier for each identified object; at least one first type of notification associated with each identified object, respectively, concerning the user; and at least one second type of notification associated with each identified object, respectively, concerning the user.

### Claim 17 (depends on 12)

The method of claim 12, further comprising:
collecting and aggregating, by an information aggregator included in the personalized notification generator, information from a plurality of sources corresponding to the user;
removing, by an information sanitizer included in the personalized notification generator and coupled to the information aggregator, redundancy from the collected information and identifying an omission in the collected information;
identifying and storing, by an information extractor included in the personalized notification generator and coupled to the information sanitizer, relevant information from a message;
prioritizing, by an information priority identifier included in the personalized notification generator and coupled to the information sanitizer, information based on context and content;
generating, by a notification generator included in the personalized notification generator and coupled to the information extractor and the information priority identifier, a notification for the user; and
storing, by a storage device included in the personalized notification generator and coupled to the notification generator, a personalized notification and a priority of the personalized notification.

### Claim 18 (depends on 17)

The method of claim 17, wherein the plurality of sources corresponding to the user comprises at least one of an electronic mail, a short message service message, and an application.

### Claim 19 (depends on 11)

The method of claim 11, further comprising performing the at least one task when the at least one task on the UI is selected and the task is available to be performed.

### Claim 20 (depends on 11)

The method of claim 11, further comprising:
storing the information;
performing various functions by a processor coupled to the memory; and
establishing, by a communication device coupled to the processor, a communication with an external device.
