Assisted drawing and writing in extended reality
AssigneeApple Inc.
InventorsBrad K. Herman, Shiraz Akmal
Life of this patent
Estimating the term…
Abstract
An example process includes: receiving, from a user, an input corresponding to a request for assistance with a drawing; in accordance with receiving the input, selecting a physical surface in a physical environment; displaying, over the selected physical surface, a graphical overlay representing the drawing, where displaying the graphical overlay over the selected physical surface includes anchoring the graphical overlay to the selected physical surface; and while displaying the graphical overlay over the selected physical surface: detecting a marking produced by the user on the physical surface, the marking corresponding to the drawing.
Claims34
A non-transitory computer-readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by one or more processors of an electronic device, cause the electronic device to:
- receive, from a user, a first input corresponding to a request for assistance with a drawing;
- in accordance with receiving the first input, select a physical surface in a physical environment;
- display, over the selected physical surface, a first instance of a graphical overlay representing the drawing, wherein displaying the first instance of the graphical overlay over the selected physical surface includes anchoring the first instance of the graphical overlay to the selected physical surface;
- while displaying the first instance of the graphical overlay over the selected physical surface, receive, from the user, a second input corresponding to a request to save a layout corresponding to the drawing;
- in accordance with receiving the second input, generate the layout corresponding to the drawing, wherein the layout indicates an anchoring of the first instance of the graphical overlay to the selected physical surface;
- and
- transmit the layout to an external electronic device, wherein after the external electronic device receives the layout, the external electronic device:
- detects the selected physical surface based on the layout;
- and
- displays, over the selected physical surface, a second instance of the graphical overlay, wherein the external electronic device anchors the second instance of the graphical overlay to the selected physical surface based on the layout.
An electronic device, comprising:
- one or more processors;
- a memory;
- and
- one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for:
- receiving, from a user, a first input corresponding to a request for assistance with a drawing;
- in accordance with receiving the first input, selecting a physical surface in a physical environment;
- displaying, over the selected physical surface, a first instance of a graphical overlay representing the drawing, wherein displaying the first instance of the graphical overlay over the selected physical surface includes anchoring the first instance of the graphical overlay to the selected physical surface;
- while displaying the first instance of the graphical overlay over the selected physical surface, receiving, from the user, a second input corresponding to a request to save a layout corresponding to the drawing;
- in accordance with receiving the second input, generating the layout corresponding to the drawing, wherein the layout indicates an anchoring of the first instance of the graphical overlay to the selected physical surface;
- and
- transmitting the layout to an external electronic device, wherein after the external electronic device receives the layout, the external electronic device:
- detects the selected physical surface based on the layout;
- and
- displays, over the selected physical surface, a second instance of the graphical overlay, wherein the external electronic device anchors the second instance of the graphical overlay to the selected physical surface based on the layout.
A method, comprising:
- at an electronic device with one or more processors and memory:
- receiving, from a user, a first input corresponding to a request for assistance with a drawing;
- in accordance with receiving the first input, selecting a physical surface in a physical environment;
- displaying, over the selected physical surface, a first instance of a graphical overlay representing the drawing, wherein displaying the first instance of the graphical overlay over the selected physical surface includes anchoring the first instance of the graphical overlay to the selected physical surface;
- while displaying the first instance of the graphical overlay over the selected physical surface, receiving, from the user, a second input corresponding to a request to save a layout corresponding to the drawing;
- in accordance with receiving the second input, generating the layout corresponding to the drawing, wherein the layout indicates an anchoring of the first instance of the graphical overlay to the selected physical surface;
- and
- transmitting the layout to an external electronic device, wherein after the external electronic device receives the layout, the external electronic device:
- detects the selected physical surface based on the layout;
- and
- displays, over the selected physical surface, a second instance of the graphical overlay, wherein the external electronic device anchors the second instance of the graphical overlay to the selected physical surface based on the layout.
Dependencies are inferred from the claim text.