# US 11,908,243 B2 · Menu hierarchy navigation on electronic mirroring devices > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 11,908,243 B2 - Document ID: US11908243B2 - Status: Granted - Kind: B2 - Application number: 17/249,848 - Filed: 2021-03-16 - Published: 2022-09-22 - Granted: 2024-02-20 - Earliest claimed: 2021-03-16 - Assignees: Snap Inc. - Applicants: Snap Inc. - Inventors: Dylan Shane Eirinberg; Kyle Goodrich; Andrew James McPhee; Daniel Moreno - Web page: https://patentgrep.com/patent/US11908243B2 ## CPC - G06V 40/23: {Recognition of whole body movements, e.g. for sport training} - G02B 27/0172: {characterised by optical features} - G06F 1/163: {Wearable computers, e.g. on a belt} - G06F 1/1686: {the I/O peripheral being an integrated camera} - G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)} - G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)} - G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)} - G06F 3/04815: Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object - G06F 3/0482: Interaction with lists of selectable items, e.g. menus - G06F 3/0488: using a touch-screen or digitiser, e.g. input of commands through traced gestures - G06F 3/1454: {involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay} - G06V 10/94: Hardware or software architectures specially adapted for image or video understanding - G06V 20/20: in augmented reality scenes - G06V 40/174: {Facial expression recognition} - G06V 40/28: {Recognition of hand or arm movements, e.g. recognition of deaf sign language (static hand signs G06V40/113)} - G02B 27/017: {Head mounted} - G02B 2027/0138: {comprising image capture systems, e.g. camera} - G02B 2027/0178: {Eyeglass type (eyeglass details G02C)} - G02B 2027/0187: {slaved to motion of at least a part of the body of the user, e.g. head, eye} - G09G 2354/00: Aspects of interface with display user - H04L 67/131: Protocols for games, networked simulations or virtual reality - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING - G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00) - H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M) ## Abstract Systems and methods are provided for performing operations comprising: capturing, by an electronic mirroring device, a video feed received from a camera of the electronic mirroring device, the video feed depicting a user; displaying, by one or more processors of the electronic mirroring device, one or more menu options on the video feed that depicts the user, the one or more menu options relating to a first level in a hierarchy of levels; detecting a gesture performed by the user in the video feed; and in response to detecting the gesture, displaying a set of options related to a given option of the one or more menu options, the set of options relating to a second level in the hierarchy of levels. ## Claims ### Claim 1 A method comprising: capturing, by an electronic mirroring device, a video feed received from a camera of the electronic mirroring device, the video feed depicting a user; displaying, by the electronic mirroring device, the video feed that depicts the user, the video feed being received from the camera of the electronic mirroring device; displaying, by one or more processors of the electronic mirroring device, one or more menu options on the displayed video feed that depicts the user, the one or more menu options relating to a first level in a hierarchy of levels; detecting overlap between a first hand of the user and a given menu option of the one or more menu options relating to the first level in the hierarchy of levels; after detecting the overlap between the first hand of the user and the given menu option, detecting a gesture performed by the user in the video feed using a combination of the first hand and a second hand of the user; and in response to detecting the gesture using the combination of the first hand and the second hand of the user after detecting the overlap between the first hand of the user and the given menu option, displaying a set of options related to a given menu option of the one or more menu options, the set of options relating to a second level in the hierarchy of levels. ### Claim 2 (depends on 1) The method of claim 1, wherein detecting the gesture comprises: determining that hands of the user are in a predetermined configuration. ### Claim 3 (depends on 2) The method of claim 2, wherein the predetermined configuration comprises at least one of the first or second hands being in a closed first configuration. ### Claim 4 (depends on 1) The method of claim 1, wherein detecting the gesture comprises: determining that a pose of a whole body of the user is in a predetermined configuration. ### Claim 5 (depends on 1) The method of claim 1, further comprising selecting an option from the set of options in response to determining that a position of the first hand of the user continues to overlap the position of the given option for an entire duration of a timer. ### Claim 6 (depends on 5) The method of claim 5, further comprising: performing an adjustment to the given menu option based on the position of the first hand that overlaps the position of the given menu option. ### Claim 7 (depends on 6) The method of claim 6, wherein the given menu option comprises a video clip generation option that causes the electronic mirroring device to capture a video clip of the user of a specified duration, and wherein the adjustment to the given menu option comprises changing the specified duration of the video clip. ### Claim 8 (depends on 1) The method of claim 1, wherein the one or more menu options comprise an undo previously captured video clip option, a video clip generation option, and a filter option. ### Claim 9 (depends on 1) The method of claim 1, wherein the given menu option comprises a video clip generation option that causes the electronic mirroring device to capture a video clip, and wherein the given menu option is a first option comprising a first augmented reality experience. ### Claim 10 (depends on 9) The method of claim 9, wherein the set of options comprises a second option relating to a second augmented reality experience. ### Claim 11 (depends on 10) The method of claim 10, wherein the first augmented reality experience comprises application of one or more augmented reality whole body outfits to the user, and wherein the second augmented reality experience comprises addition of one or more augmented reality elements to the video feed. ### Claim 12 (depends on 10) The method of claim 10, wherein the second augmented reality experience comprises launching one or more applications. ### Claim 13 (depends on 1) The method of claim 1, further comprising enabling selection of the given menu option after selecting the given menu option from the set of options. ### Claim 14 (depends on 1) The method of claim 1, wherein the electronic mirroring device comprises a stationary device in which a size of the display has a height that is greater than a height of the user, and wherein the camera is a front-facing camera that is on a same side as the display of the electronic mirroring device. ### Claim 15 (depends on 1) The method of claim 1, wherein the electronic mirroring device comprises a mobile device fixed on a camera stand, and wherein the camera is a front-facing camera that is on a same side as the display of the electronic mirroring device. ### Claim 16 (depends on 1) The method of claim 1, wherein the electronic mirroring device comprises an eyewear device through which a user views a static mirror. ### Claim 17 (depends on 16) The method of claim 16, wherein the one or more menu options are displayed by a display of the eyewear device at a position in three-dimensional space that overlaps the static mirror. ### Claim 18 (depends on 17) The method of claim 17, wherein the user sees a reflection of the user in the static mirror through lenses of the eyewear device and the one or more menu options appear as augmented reality elements on the lenses of the eyewear device on the static mirror. ### Claim 19 A system comprising: a storage device of an eyewear device; and a processor of an electronic mirroring device configured to perform operations comprising: capturing, by the electronic mirroring device, a video feed received from a camera of the electronic mirroring device, the video feed depicting a user; displaying, by the electronic mirroring device, the video feed that depicts the user, the video feed being received from the camera of the electronic mirroring device; displaying one or more menu options on the displayed video feed that depicts the user, the one or more menu options relating to a first level in a hierarchy of levels; detecting overlap between a first hand of the user and a given menu option of the one or more menu options relating to the first level in the hierarchy of levels; after detecting the overlap between the first hand of the user and the given menu option, detecting a gesture performed by the user in the video feed using a combination of the first hand and a second hand of the user; and in response to detecting the gesture using the combination of the first hand and the second hand of the user after detecting the overlap between the first hand of the user and the given menu option, displaying a set of options related to a given menu option of the one or more menu options, the set of options relating to a second level in the hierarchy of levels. ### Claim 20 A non-transitory machine-readable storage medium comprising instructions that, when executed by one or more processors of a machine, cause the machine to perform operations comprising: capturing, by an electronic mirroring device, a video feed received from a camera of the electronic mirroring device, the video feed depicting a user; displaying, by the electronic mirroring device, the video feed that depicts the user, the video feed being received from the camera of the electronic mirroring device; displaying one or more menu options on the displayed video feed that depicts the user, the one or more menu options relating to a first level in a hierarchy of levels; detecting overlap between a first hand of the user and a given menu option of the one or more menu options relating to the first level in the hierarchy of levels; after detecting the overlap between the first hand of the user and the given menu option, detecting a gesture performed by the user in the video feed using a combination of the first hand and a second hand of the user; and in response to detecting the gesture using the combination of the first hand and the second hand of the user after detecting the overlap between the first hand of the user and the given menu option, displaying a set of options related to a given menu option of the one or more menu options, the set of options relating to a second level in the hierarchy of levels.