US 2026/0093447 A1Published application

Gesture based invocation of actions for interaction with a physical environment

AssigneeApple Inc.

InventorsThomas J. MOORE, Peter BURGNER, Evan JONES, Guilherme KLINK, Tigran KHACHATRYAN, Paulo R. JANSEN DOS REIS, Christopher D. FU, Jiahui CHEN

Life of this patent

Estimating the term…

patentgrep

Loading patent…

Abstract

Some examples of the disclosure are directed to systems and methods for presenting one or more user interface elements including informational content related to information (e.g., textual information) found in an indicated region of the physical environment. In some examples, after confirming that one or more portions of a user satisfy one or more criteria (e.g., one or more portions of a user indicating a region a physical environment including textual information), the electronic device initiates image processing to generate a representation of the region of the physical environment, and optionally provides informational content related to the identified region of the physical environment.

Claims24

Dependent claims

A method comprising:

at an electronic device in communication with one or more displays, one or more input devices, and one or more optical sensors:
detecting, via the one or more optical sensors, one or more portions of a user directed toward a first object in a physical environment;
and
in response to detecting the one or more portions of the user:
in accordance with a determination that the one or more portions of the user being directed toward the first object satisfies one or more first criteria, presenting first content in association with the one or more portions of the user and the first object, the first content including informational content associated with the first object;
and
in accordance with a determination that the one or more portions of the user being directed toward the first object satisfies one or more second criteria, different from the one or more first criteria, presenting second content in association with the one or more portions of the user and the first object.

4 more elements

An electronic device, comprising:

one or more processors;
memory;
and
one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for:
detecting, via one or more optical sensors, one or more portions of a user directed toward a first object in a physical environment;
and
in response to detecting the one or more portions of the user:
in accordance with a determination that the one or more portions of the user being directed toward the first object satisfies one or more first criteria, presenting first content in association with the one or more portions of the user and the first object, the first content including informational content associated with the first object;
and
in accordance with a determination that the one or more portions of the user being directed toward the first object satisfies one or more second criteria, different from the one or more first criteria, presenting second content in association with the one or more portions of the user and the first object.

7 more elements

A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by one or more processors of an electronic device, cause the electronic device to:

detect, via one or more optical sensors, one or more portions of a user directed toward a first object in a physical environment;
and
in response to detecting the one or more portions of the user:
in accordance with a determination that the one or more portions of the user being directed toward the first object satisfies one or more first criteria, present first content in association with the one or more portions of the user and the first object, the first content including informational content associated with the first object;
and
in accordance with a determination that the one or more portions of the user being directed toward the first object satisfies one or more second criteria, different from the one or more first criteria, present second content in association with the one or more portions of the user and the first object.

3 more elements

Dependencies are inferred from the claim text.