# US 10,768,425 B2 · Augmented reality monitoring of border control systems > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,768,425 B2 - Document ID: US10768425B2 - Status: Granted - Kind: B2 - Application number: 15/897,115 - Filed: 2018-02-14 - Published: 2018-08-16 - Granted: 2020-09-08 - Earliest claimed: 2017-02-14 - Assignees: Securiport LLC - Applicants: Securiport LLC - Inventors: Nathan Carpenter; Edward Roderick; Enrique Segura - Web page: https://patentgrep.com/patent/US10768425B2 ## CPC - G02B 27/0172: {characterised by optical features} - G02B 27/32: Fiducial marks and measuring scales within the optical system - G06Q 50/265: {Personal security, identity or safety} - G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)} - G07C 9/00: Individual registration on entry or exit - G07C 9/253: {visually} - G02B 27/017: {Head mounted} - G02B 2027/0178: {Eyeglass type (eyeglass details G02C)} - G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS - G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - G07C: TIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE ## Abstract An augmented-reality device is provided. The augmented-reality device is configured to retrieve security information for a plurality of persons at respective security checkpoints. In addition, the augmented-reality device is configured to concurrently display the security information for each of the plurality of persons on an augmented-reality display. Security information is superimposed on or adjacent to each of the plurality of persons located at respective security checkpoints, the display configured to maintain visibility of the security checkpoint. ## Claims ### Claim 1 An augmented-reality device, the augmented-reality device comprising: a processor; and a non-transitory memory storing one or more programs for execution by the processor, the one or more programs including instructions for: identifying, using the processor, a plurality of persons within a user's field of view; retrieving, from a server, security information that includes identification and threat information for each of a plurality of persons within the user's field of view at respective security checkpoints; and concurrently displaying the security information for each of the plurality of persons on an augmented-reality display to the user, wherein the security information is updated in real-time and superimposed on or adjacent to each of the plurality of persons located at respective security checkpoints and within the user's field of view, the displaying of the security information is configured to maintain visibility of the respective security checkpoints, and wherein the security information being displayed to the user is based on an orientation and location of the augmented-reality display and the user's field of view relative to the respective security checkpoints as determined using one or more fiduciary markers. ### Claim 2 (depends on 1) The augmented-reality device according to claim 1, wherein one or more fiduciary markers are disposed at or adjacent to respective security checkpoints, the fiduciary markers configured to determine location information for the augmented-reality display. ### Claim 3 (depends on 2) The augmented-reality device according to claim 2, wherein one or more hyper-local location sensors are used to determine the location information. ### Claim 4 (depends on 1) The augmented-reality device according to claim 1, wherein the augmented-reality device includes augmented-reality glasses. ### Claim 5 (depends on 1) The augmented-reality device according to claim 1, wherein the augmented-reality device includes a smartphone or tablet. ### Claim 6 (depends on 1) The augmented-reality device according to claim 1, further comprising instructions for retrieving real-time image data, and superimposing the security information of the real-time image data. ### Claim 7 A non-transitory computer readable storage medium storing one or more programs configured to be executed by a processor, the one or more programs comprising instructions for: identifying, using the processor, a plurality of persons within a user's field of view; retrieving, from a server, security information that includes identification and threat information for each of a plurality of persons within the user's field of view at respective security checkpoints; and concurrently displaying the security information for each of the plurality of persons on an augmented-reality device comprising an augmented-reality display to the user, wherein the security information is updated in real-time and superimposed on or adjacent to each of the plurality of persons located at respective security checkpoints and within the user's field of view, the displaying of the security information is configured to maintain visibility of the respective security checkpoints, and wherein the security information being displayed is based on an orientation and location of the augmented-reality display and the user's field of view relative to the respective security checkpoints as determined using one or more fiduciary markers. ### Claim 8 (depends on 7) The non-transitory computer readable storage medium according to claim 7, wherein one or more fiduciary markers are disposed at or adjacent to respective security checkpoints, the fiduciary markers configured to determine location information for the augmented-reality display. ### Claim 9 (depends on 8) The non-transitory computer readable storage medium according to claim 8, wherein one or more hyper-local location sensors are used to determine the location information. ### Claim 10 (depends on 7) The non-transitory computer readable storage medium according to claim 7, wherein the augmented-reality device includes augmented-reality glasses. ### Claim 11 (depends on 7) The non-transitory computer readable storage medium according to claim 7, wherein the augmented-reality device includes a smartphone or tablet. ### Claim 12 (depends on 7) The non-transitory computer readable storage medium according to claim 7, further comprising instructions for retrieving real-time image data, and superimposing the security information of the real-time image data. ### Claim 13 A method for operating an augmented-reality device, the method comprising: identifying, using the processor, a plurality of persons within a user's field of view; retrieving, from a server, security information that includes identification and threat information for each of a plurality of persons within a user's field of view at respective security checkpoints; and concurrently displaying the security information for each of the plurality of persons on an augmented-reality device comprising an augmented-reality display to the user, wherein the security information is updated in real-time and superimposed on or adjacent to each of the plurality of persons located at respective security checkpoints and within the user's field of view, the displaying of the security information is configured to maintain visibility of the respective security checkpoints, and wherein the security information being displayed is based on an orientation and location of the augmented-reality display and the user's field of view relative to the respective security checkpoints as determined using one or more fiduciary markers. ### Claim 14 (depends on 13) The method according to claim 13, wherein one or more fiduciary markers are disposed at or adjacent to respective security checkpoints, the fiduciary markers configured to determine location information for the augmented-reality display. ### Claim 15 (depends on 14) The method according to claim 14, wherein one or more hyper-local location sensors are used to determine the location information. ### Claim 16 (depends on 13) The method according to claim 13, wherein the augmented-reality device includes augmented-reality glasses. ### Claim 17 (depends on 13) The method according to claim 13, wherein the augmented-reality device includes smartphone or tablet. ### Claim 18 (depends on 13) The method according to claim 13, further comprising instructions for retrieving real-time image data, and superimposing the security information of the real-time image data. ### Claim 19 (depends on 1) The augmented-reality device according to claim 1, wherein the security information being displayed to the user based on an orientation and location of the augmented-reality display is relative to a checkpoint and displayed in real-time. ### Claim 20 (depends on 13) The method according to claim 13, wherein the security information being displayed to the user based on an orientation and location of the augmented-reality display is relative to a checkpoint and displayed in real-time.