# US 12,002,169 B2 · System and method for selecting targets in an augmented reality environment > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,002,169 B2 - Document ID: US12002169B2 - Status: Granted - Kind: B2 - Application number: 17/887,075 - Filed: 2022-08-12 - Published: 2022-12-08 - Granted: 2024-06-04 - Earliest claimed: 2012-05-01 - Assignees: Samsung Electronics Co., Ltd. - Applicants: Samsung Electronics Co., Ltd. - Inventors: Nova T. Spivack - Web page: https://patentgrep.com/patent/US12002169B2 ## CPC - G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)} - G02B 27/017: {Head mounted} - G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)} - G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)} - G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)} - G06F 3/0488: using a touch-screen or digitiser, e.g. input of commands through traced gestures - G06Q 30/0623: {by investigating goods or services} - G06Q 30/0639: {Locating goods or services, e.g. based on physical position of the goods or services within a shopping facility} - G06Q 30/0641: {utilising user interfaces specially adapted for shopping} - G06Q 30/0643: {graphically representing goods, e.g. 3D product representation} - G06V 20/20: in augmented reality scenes - G09G 5/377: for mixing or overlaying two or more graphic patterns (G09G5/02, G09G5/397 take precedence) - G02B 2027/0178: {Eyeglass type (eyeglass details G02C)} - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING - G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00) ## Abstract Techniques are disclosed for facilitating electronic commerce in an augmented reality environment. In some embodiments, a method comprises detecting, by a mobile device, presence of the physical product or the real life service; and presenting, on the mobile device, information to conduct the transaction of a physical product or a real life service via the augmented reality environment. In some embodiments, a method comprises detecting one or more targets in the augmented reality platform using a select area in a perspective of a user, the perspective being captured by a mobile device; and prompting the user to choose an object of interest from the one or more detected targets. ## Claims ### Claim 1 A mobile device comprising: a touch-sensitive display; a camera; a processor; and a memory coupled to the processor and storing instructions which, when executed by the processor, cause the mobile device to: display an image, being captured via the camera, detect a presence of one or more physical objects in the image, display a selection tool in the image to form a selected area for selecting a target among the one or more physical objects in the image, receive a user input for moving the selection tool, and when the target is selected based on the user input, display information for conducting a transaction of a product based on information of the product corresponding to the selected target, wherein the displayed information comprises information regarding the product and information regarding similar product relating to the product. ### Claim 2 (depends on 1) The mobile device of claim 1, wherein the memory further stores instructions which, when executed by the processor, cause the mobile device to: prompt, via the touch-sensitive display, the user to enter a mode in which the mobile device receives assistance from the user to perform the detection. ### Claim 3 (depends on 2) The mobile device of claim 2, wherein the memory further stores instructions which, when executed by the processor, cause the mobile device to: provide, via the touch-sensitive display, the user with the selection tool in a perspective to form the select area, and receive a user input for selecting a target corresponding to the selected area by using the selection tool. ### Claim 4 (depends on 3) The mobile device of claim 3, wherein the memory further stores instructions which, when executed by the processor, cause the mobile device to: receive a user input for moving the selected area, and change another target based on the user input. ### Claim 5 (depends on 3) The mobile device of claim 3, wherein the memory further stores instructions which, when executed by the processor, cause the mobile device to: receive a user input for changing a size of the selected area, and detect the target based on the selected area resized. ### Claim 6 (depends on 1) The mobile device of claim 1, wherein the displayed information comprises an advertisement regarding the product and another similar product relating to the product. ### Claim 7 (depends on 1) The mobile device of claim 1, wherein the displayed information comprises at least one of purchase information, price information or vendor information of the product and another similar product relating to the product. ### Claim 8 (depends on 1) The mobile device of claim 1, wherein the memory further stores instructions which, when executed by the processor, cause the mobile device to: detect the presence of the target in the selected area based on geolocation information of the mobile device. ### Claim 9 A method for selecting a target representing a physical object, via a mobile device, the method comprising: displaying an image, being captured via a camera of the mobile device; detecting a presence of one or more physical objects in the image; display a selection tool in the image to form a select area for selecting the target among the one or more physical objects in the image; receiving a user input for moving the selection tool; and when the target is selected based on the user input, displaying information for conducting a transaction of a product based on the information of the product corresponding to the selected target, wherein the displayed information comprises information regarding the product and another similar product relating to the product and information regarding similar product relating to the product. ### Claim 10 (depends on 9) The method of claim 9, wherein the method further comprises: prompting, via a touch-sensitive display of the mobile device, the user to enter a mode in which the mobile device receives assistance from the user to select the target. ### Claim 11 (depends on 10) The method of claim 10, wherein the method further comprises: providing, via the touch-sensitive display, the user with the selection tool in a perspective to form a select area; and receiving a user input for selecting the target corresponding to the selected area by using the selection tool. ### Claim 12 (depends on 11) The method of claim 11, wherein the method further comprises: receiving the user input for moving the selected area; and changing another target based on the user input. ### Claim 13 (depends on 11) The method of claim 11, wherein the method further comprises: receiving the user input for changing a size of the selected area; and detecting the target based on the selected area resized. ### Claim 14 (depends on 9) The method of claim 9, wherein the displayed information comprises an advertisement regarding the product and another similar product relating to the product. ### Claim 15 (depends on 9) The method of claim 9, wherein the displayed information comprises at least one of purchase information, price information or vendor information of the product and another similar product relating to the product. ### Claim 16 (depends on 9) The method of claim 9, wherein the method further comprises: detecting the presence of the target in the selected area based on geolocation information of the mobile device. ### Claim 17 (depends on 1) The mobile device of claim 1, wherein when the user input is received via sensors, and wherein the sensors determine a gesture from one or more of movements or non-movements of an eye of the user, locations of a focal point of an eye of the user, or movements of an eye lid of the user.