# US 12,111,904 B2 · Systems and methods for authenticating users > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,111,904 B2 - Document ID: US12111904B2 - Status: Granted - Kind: B2 - Application number: 18/331,926 - Filed: 2023-06-08 - Published: 2023-10-05 - Granted: 2024-10-08 - Earliest claimed: 2020-04-16 - Assignees: Capital One Services, LLC - Applicants: Capital One Services, LLC - Inventors: Joshua Edwards; Lukiih Cuan; Eric Loucks - Web page: https://patentgrep.com/patent/US12111904B2 ## CPC - G06F 21/34: involving the use of external additional devices, e.g. dongles or smart cards - G06F 21/36: by graphic or iconic representation - G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)} - G06F 40/30: Semantic analysis - G06T 7/10: Segmentation; Edge detection (motion-based segmentation G06T7/215) - G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80) - G06T 11/20: Drawing from basic elements - G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)} - G06V 20/20: in augmented reality scenes - G06F 40/56: Natural language generation - G06F 2221/2103: Challenge-response - G06T 2210/12: Bounding box - G06V 2201/10: Recognition assisted with metadata - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING ## Abstract In some embodiments, an authentication prompt may be generated based on (i) an object, detected in an image stream of an environment of a user, satisfying one or more criteria and (ii) object data associated with the detected object. The criteria may include (i) the object being in a plurality of different samples and (ii) the object being in a first spatial region of a first sample of the different samples, where the first spatial region of the first sample is a spatial region at which the user looked. An authentication response may be obtained from a user device of the user in connection with the authentication prompt, and the user may be authenticated based on the authentication response obtained from the user device. ## Claims ### Claim 1 A system for facilitating user authentication, the system comprising: one or more processors programmed with instructions that, when executed by the one or more processors, cause operations comprising: obtaining an image stream of an environment of a user; in response to detecting that (i) an object occurred in a threshold sample number of different samples of the image stream and (ii) the object is in a first spatial region of a first sample of the different samples, generating an authentication question using object data associated with the detected object, wherein: the first spatial region of the first sample is a spatial region at which the user looked, the object data comprises attributes of the object derived from the image stream, and the authentication question comprises a question related to one or more of the attributes; obtaining an authentication response from a user device of the user in connection with the authentication question, wherein the authentication response comprises the one or more of the attributes of the object; and authenticating the user based on a determination that the authentication response matches a pre-determined answer to the authentication question. ### Claim 2 (depends on 1) The system of claim 1, the operations further comprising: determining the threshold sample number and a threshold amount of time between each of the different samples; wherein generating the authentication question comprises: storing, in a database, the object data associated with the object detected in the different samples of the image stream; and in response to a request to authenticate the user, generating the authentication question based on the detection of the object satisfying the threshold sample number and the threshold amount of time between each of the different samples. ### Claim 3 (depends on 1) The system of claim 1, wherein the attributes of the object data comprise an acquisition time or location at which the image stream was captured by an image capturing device associated with the user. ### Claim 4 (depends on 1) The system of claim 1, wherein the image stream comprises a video stream of the environment of the user captured via an augmented reality application. ### Claim 5 A method comprising: determining that an object detected in a set of images related to an environment of a user satisfies one or more criteria, the one or more criteria comprising (i) the object being in a plurality of different samples and (ii) the object being in a first spatial region of a first sample of the plurality of different samples, wherein the first spatial region of the first sample is a spatial region at which the user looked; generating an authentication question based on (i) the object detected in the set of images satisfying the one or more criteria and (ii) object data associated with the detected object, the object data comprising attributes of the object derived from the set of images, and the authentication question comprising a question related to one or more of the attributes; and authenticating the user based on an authentication response obtained from a user device of the user in connection with the authentication question matching a pre-determined response to the authentication question. ### Claim 6 (depends on 5) The method of claim 5, further comprising: storing, in a database, the object data associated with the object detected in the plurality of different samples of the set of images; and obtaining a request to authenticate the user, wherein the authentication question is generated in response to the request to authenticate the user based on (i) the object detected in the set of images satisfying the one or more criteria and (ii) the object data associated with the detected object. ### Claim 7 (depends on 5) The method of claim 5, wherein the one or more criteria comprises the object being detected in sequential samples for a threshold number of samples. ### Claim 8 (depends on 5) The method of claim 5, wherein the one or more criteria comprises the plurality of different samples satisfying a threshold amount of time between samples. ### Claim 9 (depends on 5) The method of claim 5, wherein the one or more criteria comprises (i) the object moving in the set of images in a manner consistent with motion data of an image capturing device associated with the user, the motion data representing movement of the image capturing device while the set of images is captured by the image capturing device. ### Claim 10 (depends on 5) The method of claim 5, wherein generating the authentication question comprises: selecting, based on an acquisition time of the set of images satisfying an acquisition recency threshold, the one or more of the attributes to be used for generating the authentication question. ### Claim 11 (depends on 5) The method of claim 5, wherein the attributes of the object data comprise an acquisition time or location at which the set of images was captured by an image capturing device associated with the user. ### Claim 12 (depends on 5) The method of claim 5, wherein the set of images is captured via an augmented reality application. ### Claim 13 One or more non-transitory computer-readable media storing instructions that, when executed by one or more processors, cause operations comprising: determining that an object detected in a set of images related to an environment of a user satisfies one or more criteria, the one or more criteria comprising (i) the object being in a plurality of different samples and (ii) the object being in a first spatial region of a first sample of the plurality of different samples, wherein the first spatial region of the first sample is a spatial region at which the user looked; generating and providing an authentication prompt based on (i) the object detected in the set of images satisfying the one or more criteria and (ii) object data associated with the detected object, the object data comprising attributes of the object derived from the set of images, and the authentication prompt comprising a question related to one or more of the attributes; and authenticating the user based on an authentication response obtained from a user device of the user in connection with the authentication prompt matching a pre-determined response to the authentication prompt. ### Claim 14 (depends on 13) The one or more non-transitory computer-readable media of claim 13, the operations further comprising: storing, in a database, the object data associated with the object detected in the plurality of different samples of the set of images; and obtaining a request to authenticate the user, wherein the authentication prompt is generated in response to the request to authenticate the user based on (i) the object detected in the set of images satisfying the one or more criteria and (ii) the object data associated with the detected object. ### Claim 15 (depends on 13) The one or more non-transitory computer-readable media of claim 13, wherein the one or more criteria comprises the object being detected in sequential samples for a threshold number of samples. ### Claim 16 (depends on 13) The one or more non-transitory computer-readable media of claim 13, wherein the one or more criteria comprises the plurality of different samples satisfying a threshold amount of time between samples. ### Claim 17 (depends on 13) The one or more non-transitory computer-readable media of claim 13, wherein the one or more criteria comprises (i) the object moving in the set of images in a manner consistent with motion data of an image capturing device associated with the user, the motion data representing movement of the image capturing device while the set of images is captured by the image capturing device. ### Claim 18 (depends on 13) The one or more non-transitory computer-readable media of claim 13, wherein generating and providing the authentication prompt comprises: selecting, based on an acquisition time of the set of images satisfying an acquisition recency threshold, the one or more of the attributes to be used for generating the authentication prompt. ### Claim 19 (depends on 13) The one or more non-transitory computer-readable media of claim 13, wherein the attributes of the object data comprise an acquisition time or location at which the set of images was captured by an image capturing device associated with the user. ### Claim 20 (depends on 13) The one or more non-transitory computer-readable media of claim 13, wherein the set of images is captured via an augmented reality application.