# US 12,008,724 B2 · Method for determining correct scanning distance using augmented reality and machine learning models > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,008,724 B2 - Document ID: US12008724B2 - Status: Granted - Kind: B2 - Application number: 18/101,982 - Filed: 2023-01-26 - Published: 2023-10-05 - Granted: 2024-06-11 - Earliest claimed: 2018-10-23 - Assignees: Capital One Services, LLC - Applicants: Capital One Services, LLC - Inventors: Staevan Duckworth; Daniel Martinez; William Hardin; Jonathan Castaneda; Susie Lee - Web page: https://patentgrep.com/patent/US12008724B2 ## CPC - G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)} - G01B 11/026: {by measuring distance between sensor and object (G01B11/0608 takes precedence)} - G01B 11/03: by measuring coordinates of points - G06F 3/01: Input arrangements or combined input and output arrangements for interaction between user and computer (G06F3/16 takes precedence) - G06F 16/9535: Search customisation based on user profiles and personalisation - G06F 17/18: for evaluating statistical data {, e.g. average values, frequency distributions, probability functions, regression analysis (forecasting specially adapted for a specific administrative, business or logistic context G06Q10/04)} - G06N 20/00: Machine learning - G06T 7/73: using feature-based methods - G06V 10/17: {using hand-held instruments} - G06V 10/764: using classification, e.g. of video objects - G06V 20/20: in augmented reality scenes - G06V 20/584: {of vehicle lights or traffic lights} - G06V 20/64: Three-dimensional [3D] objects - G06T 2207/20081: Training; Learning - G06T 2207/30252: Vehicle exterior; Vicinity of vehicle - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - G01B: MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING ## Abstract A smart device is provided with an application program for displaying a video feed received from the smart device's camera. The application can determine the coordinates for an intersection point, which is a point on the ground where the smart device is pointing at. The application can display a target on the visual representation of the intersection point. Based on whether the smart device is at an appropriate distance from the intersection point, the user interface can superimpose an indicator on the video feed received from the camera. This can inform the user whether the smart device is at an optimal scan distance from the intersection point (or an object) so that the object can be identified by a machine learning model. ## Claims ### Claim 1 A non-transitory computer-accessible medium having stored thereon computer-executable instructions executable by a computing hardware arrangement, wherein, when the computing hardware arrangement executes the instructions, the computing hardware arrangement is configured to perform procedures comprising: displaying, on a display, a video feed captured by a camera from a first position; determining an intersection point between a ground plane and the first position; displaying a target over a visual representation of the intersection point on the display; determining a distance between the first position and the intersection point; and capturing by the camera an image of an object in the video feed when the distance between the first position and the intersection point is within an optimal scan distance. ### Claim 2 (depends on 1) The non-transitory computer-accessible medium of claim 1, wherein the computing hardware arrangement further comprises instruction for identifying, using an object recognition model, an object in the video feed. ### Claim 3 (depends on 2) The non-transitory computer-accessible medium of claim 2, wherein the computing hardware arrangement further comprises instruction for displaying information about the identified object on the display. ### Claim 4 (depends on 1) The non-transitory computer-accessible medium of claim 1, wherein the intersection point is a point on a ground plane where a perpendicular hypothetical line extending from the first position would intersect the ground plane. ### Claim 5 (depends on 1) The non-transitory computer-accessible medium of claim 1, wherein the optimal scanning distance is determined based on a threshold percentage of a field of view being occupied by the object. ### Claim 6 (depends on 1) The non-transitory computer-accessible medium of claim 1, wherein the optimal scan distance is a learned value received from the object recognition model. ### Claim 7 (depends on 1) The non-transitory computer-accessible medium of claim 1, wherein the intersection point corresponds to a center point of a field of view of the camera located at the first position. ### Claim 8 (depends on 1) The non-transitory computer-accessible medium of claim 1, wherein the image of the object is captured automatically based upon the distance between the first position and the intersection point. ### Claim 9 (depends on 1) The non-transitory computer-accessible medium of claim 1, wherein the optimal scan distance is determined based on an altitude of the first position relative to the ground plane. ### Claim 10 (depends on 1) The non-transitory computer-accessible medium of claim 1, wherein the optical scan distance is determined based on a field of view and an angular separation of pixels of the camera located at the first position. ### Claim 11 (depends on 2) The non-transitory computer-accessible medium of claim 2, wherein the computing hardware arrangement further comprises instruction displaying a notification in the video feed upon the capture of the image of the object. ### Claim 12 A method comprising: displaying, on a display, a video feed captured by a camera from a first position; determining an intersection point between a ground plane and the first position; displaying a target over a visual representation of the intersection point; determining a distance between the first position and the intersection point; and capturing by the camera an image of an object in the video feed when the distance between the first position and the intersection point is within an optimal scan distance. ### Claim 13 (depends on 12) The method of claim 12, further comprising: identifying, using an object recognition model, an object in the video feed. ### Claim 14 (depends on 13) The method of claim 13, further comprising: displaying information about the identified object on the display. ### Claim 15 (depends on 12) The method of claim 12, wherein the intersection point is a point on a ground plane where a perpendicular hypothetical line extending from the first position would intersect the ground plane. ### Claim 16 (depends on 12) The method of claim 12, wherein the optimal scanning distance is determined based on a threshold percentage of a field of view being occupied by the object. ### Claim 17 (depends on 12) The method of claim 12, wherein the optimal scan distance is a learned value received from the object recognition model. ### Claim 18 (depends on 12) The method of claim 12, wherein the intersection point corresponds to a center point of a field of view of the camera located at the first position. ### Claim 19 (depends on 12) The method of claim 12, wherein the image of the object is captured automatically based upon the distance between the first position and the intersection point. ### Claim 20 (depends on 12) The method of claim 12, wherein the optimal scan distance is determined based on an altitude of the first position relative to the ground plane. ### Claim 21 (depends on 12) The method of claim 12, wherein the optical scan distance is determined based on a field of view and an angular separation of pixels of the camera located at the first position. ### Claim 22 A device comprising: a camera configured to capture a video feed from a first position; a display configured to display the video feed; and a processor, wherein the processor is configured to: display, on the display, a video feed captured by a camera from a first position; determine an intersection point between a ground plane and the first position; display a target over a visual representation of the intersection point; determine a distance between the first position and the intersection point; and capture, by the camera, an image of an object in the video feed when the distance between the first position and the intersection point is within an optimal scan distance.