# US 12,602,108 B2 · Systems and methods of updating a manner of display of three-dimensional objects > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,602,108 B2 - Document ID: US12602108B2 - Status: Granted - Kind: B2 - Application number: 18/527,007 - Filed: 2023-12-01 - Published: 2024-06-13 - Granted: 2026-04-14 - Earliest claimed: 2022-12-09 - Assignees: Apple Inc. - Applicants: Apple Inc. - Inventors: Gregory Lutter; Peter Burgner; Manuel C. Clement; In Young Yang; Thomas G. Salter; Alesha Unpingco; Lee Sparks - Web page: https://patentgrep.com/patent/US12602108B2 ## CPC - G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)} - G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)} - G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)} - G06F 3/04815: Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object - G06F 3/0484: for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range - G06F 3/04842: Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence) - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) ## Abstract Some examples of the disclosure are directed to systems and methods for minimizing display of an object from a maximized state to a minimized state in a three-dimensional environment. In some examples, an electronic device presents a computer-generated environment that includes a virtual object displayed in a maximized state in the three-dimensional environment. While displaying the three-dimensional environment, the electronic device detects that a first event has occurred. In response to detecting that the first event has occurred, in accordance with a determination that the first event satisfies one or more criteria, the electronic device displays the virtual object in a minimized state in the three-dimensional environment from a viewpoint of a user of the electronic device. In accordance with a determination that the first event does not satisfy the one or more criteria, the electronic device maintains display of the virtual object in the maximized state from the viewpoint. ## Claims ### Claim 1 A method comprising: at an electronic device in communication with a display and one or more input devices: presenting, via the display, a three-dimensional environment including a first object, wherein the first object is displayed in a first manner in the three-dimensional environment relative to a viewpoint of a user of the electronic device, including displaying the first object at a first location in the three-dimensional environment that is at a center of a field of view of the user; while presenting the three-dimensional environment including the first object that is displayed in the first manner, detecting that a first event has occurred, including rotation of the viewpoint of the user relative to the three-dimensional environment; and in response to detecting that the first event has occurred: in accordance with a determination that the first event satisfies one or more criteria, including a criterion that is satisfied when a vertical component of the rotation of the viewpoint of the user exceeds a threshold angle relative to a reference, displaying, via the display, the first object in a second manner, different from the first manner, in the three-dimensional environment relative to the viewpoint of the user, including displaying the first object at a second location, different from the first location, in the three-dimensional environment that is outside the center of the field of view of the user; and in accordance with a determination that the first event does not satisfy the one or more criteria, maintaining display of the first object in the first manner in the three-dimensional environment relative to the viewpoint of the user. ### Claim 2 (depends on 1) The method of claim 1, wherein: displaying the first object in the first manner in the three-dimensional environment includes displaying the first object at a first location in the three-dimensional environment relative to a first predefined portion of the user according to a first coordinate system; and displaying the first object in the second manner in the three-dimensional environment includes displaying the first object at a second location in the three-dimensional environment relative to a second predefined portion, different from the first predefined portion, of the user according to a second coordinate system, different from the first coordinate system. ### Claim 3 (depends on 1) The method of claim 1, wherein: detecting that the first event has occurred includes detecting movement of the viewpoint of the user relative to the three-dimensional environment; and the one or more criteria include a criterion that is satisfied when the movement of the viewpoint of the user exceeds a threshold movement. ### Claim 4 (depends on 1) The method of claim 1, wherein: detecting that the first event has occurred includes initiating countdown of a timer associated with the display of the first object in the first manner in the three-dimensional environment; and the one or more criteria include a criterion that is satisfied when the countdown reaches an end of the timer. ### Claim 5 (depends on 1) The method of claim 1, wherein: detecting that the first event has occurred includes detecting movement of a gaze of the user in the three-dimensional environment; and the one or more criteria include a criterion that is satisfied when, after the movement of the gaze of the user, the gaze of the user is directed to a target other than the first object in the three-dimensional environment. ### Claim 6 (depends on 1) The method of claim 1, further comprising: while displaying the first object in the second manner in the three-dimensional environment in accordance with the determination that the first event satisfies the one or more criteria in response to detecting that the first event has occurred, detecting that a second event has occurred; and in response to detecting that the second event has occurred and in accordance with a determination that the second event satisfies one or more second criteria, redisplaying, via the display, the first object in the first manner in the three-dimensional environment relative to the viewpoint of the user. ### Claim 7 (depends on 6) The method of claim 6, wherein: detecting that the first event has occurred includes detecting movement of the viewpoint of the user from a first viewpoint to a second viewpoint that exceeds a threshold movement; and the one or more second criteria include a criterion that is satisfied when detecting that the second event has occurred includes detecting movement of the viewpoint of the user back to the first viewpoint. ### Claim 8 (depends on 6) The method of claim 6, wherein: the first object is displayed with a plurality of selectable options in the three-dimensional environment; detecting that the first event has occurred includes receiving, via the one or more input devices, a selection of a first option of the plurality of selectable options; and the one or more second criteria include a criterion that is satisfied when detecting that the second event has occurred includes receiving a selection of a second option of the plurality of selectable options. ### Claim 9 (depends on 1) The method of claim 1, wherein: displaying the first object in the first manner in the three-dimensional environment includes displaying the first object with a first locked orientation in the three-dimensional environment; and displaying the first object in the second manner in the three-dimensional environment includes displaying the first object with a second locked orientation, different from the first locked orientation, in the three-dimensional environment. ### Claim 10 An electronic device comprising: one or more processors; memory; and one or more programs stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for performing a method comprising: presenting, via a display, a three-dimensional environment including a first object, wherein the first object is displayed in a first manner in the three-dimensional environment relative to a viewpoint of a user of the electronic device, including displaying the first object at a first location in the three-dimensional environment that is at a center of a field of view of the user; while presenting the three-dimensional environment including the first object that is displayed in the first manner, detecting that a first event has occurred, including rotation of the viewpoint of the user relative to the three-dimensional environment; and in response to detecting that the first event has occurred: in accordance with a determination that the first event satisfies one or more criteria, including a criterion that is satisfied when a vertical component of the rotation of the viewpoint of the user exceeds a threshold angle relative to a reference, displaying, via the display, the first object in a second manner, different from the first manner, in the three-dimensional environment relative to the viewpoint of the user, including displaying the first object at a second location, different from the first location, in the three-dimensional environment that is outside the center of the field of view of the user; and in accordance with a determination that the first event does not satisfy the one or more criteria, maintaining display of the first object in the first manner in the three-dimensional environment relative to the viewpoint of the user. ### Claim 11 (depends on 10) The electronic device of claim 10, wherein: displaying the first object in the first manner in the three-dimensional environment includes displaying the first object at a first location in the three-dimensional environment relative to a first predefined portion of the user according to a first coordinate system; and displaying the first object in the second manner in the three-dimensional environment includes displaying the first object at a second location in the three-dimensional environment relative to a second predefined portion, different from the first predefined portion, of the user according to a second coordinate system, different from the first coordinate system. ### Claim 12 (depends on 10) The electronic device of claim 10, wherein: detecting that the first event has occurred includes detecting movement of the viewpoint of the user relative to the three-dimensional environment; and the one or more criteria include a criterion that is satisfied when the movement of the viewpoint of the user exceeds a threshold movement. ### Claim 13 (depends on 10) The electronic device of claim 10, wherein: detecting that the first event has occurred includes initiating countdown of a timer associated with the display of the first object in the first manner in the three-dimensional environment; and the one or more criteria include a criterion that is satisfied when the countdown reaches an end of the timer. ### Claim 14 (depends on 10) The electronic device of claim 10, wherein: detecting that the first event has occurred includes detecting movement of a gaze of the user in the three-dimensional environment; and the one or more criteria include a criterion that is satisfied when, after the movement of the gaze of the user, the gaze of the user is directed to a target other than the first object in the three-dimensional environment. ### Claim 15 (depends on 10) The electronic device of claim 10, wherein the method further comprises: while displaying the first object in the second manner in the three-dimensional environment in accordance with the determination that the first event satisfies the one or more criteria in response to detecting that the first event has occurred, detecting that a second event has occurred; and in response to detecting that the second event has occurred and in accordance with a determination that the second event satisfies one or more second criteria, redisplaying, via the display, the first object in the first manner in the three-dimensional environment relative to the viewpoint of the user. ### Claim 16 (depends on 15) The electronic device of claim 15, wherein: detecting that the first event has occurred includes detecting movement of the viewpoint of the user from a first viewpoint to a second viewpoint that exceeds a threshold movement; and the one or more second criteria include a criterion that is satisfied when detecting that the second event has occurred includes detecting movement of the viewpoint of the user back to the first viewpoint. ### Claim 17 (depends on 15) The electronic device of claim 15, wherein: the first object is displayed with a plurality of selectable options in the three-dimensional environment; detecting that the first event has occurred includes receiving, via one or more input devices, a selection of a first option of the plurality of selectable options; and the one or more second criteria include a criterion that is satisfied when detecting that the second event has occurred includes receiving a selection of a second option of the plurality of selectable options. ### Claim 18 (depends on 10) The electronic device of claim 10, wherein: displaying the first object in the first manner in the three-dimensional environment includes displaying the first object with a first locked orientation in the three-dimensional environment; and displaying the first object in the second manner in the three-dimensional environment includes displaying the first object with a second locked orientation, different from the first locked orientation, in the three-dimensional environment. ### Claim 19 A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by one or more processors of an electronic device, cause the electronic device to perform a method comprising: presenting, via a display, a three-dimensional environment including a first object, wherein the first object is displayed in a first manner in the three-dimensional environment relative to a viewpoint of a user of the electronic device, including displaying the first object at a first location in the three-dimensional environment that is at a center of a field of view of the user; while presenting the three-dimensional environment including the first object that is displayed in the first manner, detecting that a first event has occurred, including rotation of the viewpoint of the user relative to the three-dimensional environment; and in response to detecting that the first event has occurred: in accordance with a determination that the first event satisfies one or more criteria, including a criterion that is satisfied when a vertical component of the rotation of the viewpoint of the user exceeds a threshold angle relative to a reference, displaying, via the display, the first object in a second manner, different from the first manner, in the three-dimensional environment relative to the viewpoint of the user, including displaying the first object at a second location, different from the first location, in the three-dimensional environment that is outside the center of the field of view of the user; and in accordance with a determination that the first event does not satisfy the one or more criteria, maintaining display of the first object in the first manner in the three-dimensional environment relative to the viewpoint of the user. ### Claim 20 (depends on 19) The non-transitory computer readable storage medium of claim 19, wherein: displaying the first object in the first manner in the three-dimensional environment includes displaying the first object at a first location in the three-dimensional environment relative to a first predefined portion of the user according to a first coordinate system; and displaying the first object in the second manner in the three-dimensional environment includes displaying the first object at a second location in the three-dimensional environment relative to a second predefined portion, different from the first predefined portion, of the user according to a second coordinate system, different from the first coordinate system. ### Claim 21 (depends on 19) The non-transitory computer readable storage medium of claim 19, wherein: detecting that the first event has occurred includes detecting movement of the viewpoint of the user relative to the three-dimensional environment; and the one or more criteria include a criterion that is satisfied when the movement of the viewpoint of the user exceeds a threshold movement. ### Claim 22 (depends on 19) The non-transitory computer readable storage medium of claim 19, wherein: detecting that the first event has occurred includes initiating countdown of a timer associated with the display of the first object in the first manner in the three-dimensional environment; and the one or more criteria include a criterion that is satisfied when the countdown reaches an end of the timer. ### Claim 23 (depends on 19) The non-transitory computer readable storage medium of claim 19, wherein: detecting that the first event has occurred includes detecting movement of a gaze of the user in the three-dimensional environment; and the one or more criteria include a criterion that is satisfied when, after the movement of the gaze of the user, the gaze of the user is directed to a target other than the first object in the three-dimensional environment. ### Claim 24 (depends on 19) The non-transitory computer readable storage medium of claim 19, wherein the method further comprises: while displaying the first object in the second manner in the three-dimensional environment in accordance with the determination that the first event satisfies the one or more criteria in response to detecting that the first event has occurred, detecting that a second event has occurred; and in response to detecting that the second event has occurred and in accordance with a determination that the second event satisfies one or more second criteria, redisplaying, via the display, the first object in the first manner in the three-dimensional environment relative to the viewpoint of the user. ### Claim 25 (depends on 24) The non-transitory computer readable storage medium of claim 24, wherein: detecting that the first event has occurred includes detecting movement of the viewpoint of the user from a first viewpoint to a second viewpoint that exceeds a threshold movement; and the one or more second criteria include a criterion that is satisfied when detecting that the second event has occurred includes detecting movement of the viewpoint of the user back to the first viewpoint. ### Claim 26 (depends on 24) The non-transitory computer readable storage medium of claim 24, wherein: the first object is displayed with a plurality of selectable options in the three-dimensional environment; detecting that the first event has occurred includes receiving, via one or more input devices, a selection of a first option of the plurality of selectable options; and the one or more second criteria include a criterion that is satisfied when detecting that the second event has occurred includes receiving a selection of a second option of the plurality of selectable options. ### Claim 27 (depends on 19) The non-transitory computer readable storage medium of claim 19, wherein: displaying the first object in the first manner in the three-dimensional environment includes displaying the first object with a first locked orientation in the three-dimensional environment; and displaying the first object in the second manner in the three-dimensional environment includes displaying the first object with a second locked orientation, different from the first locked orientation, in the three-dimensional environment.