# US 2021/0340804 A1 · Information processing device > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2021/0340804 A1 - Document ID: US20210340804A1 - Status: Published application - Kind: A1 - Application number: 16/966,392 - Filed: 2019-01-24 - Published: 2021-11-04 - Earliest claimed: 2018-01-31 - Assignees: NEC Corporation - Applicants: NEC Corporation - Inventors: Taketo KOCHI; Kenji SAITO - Web page: https://patentgrep.com/patent/US20210340804A1 ## CPC - G07C 9/10: Movable barriers with registering means - E05B 49/00: Electric permutation locks; Circuits therefor {; Mechanical aspects of electronic locks; Mechanical keys therefor (arrangements for sensing or reading record carriers G06K7/00; mechanisms including electronic locks actuated by nonmechanical keys such as passive and active electrical keys and other data carriers G07C9/00, G07F7/00; electronic switching H03K17/00)} - E05F 15/73: responsive to movement or presence of persons or objects - G06F 18/22: Matching criteria, e.g. proximity measures - G06T 7/00: Image analysis - G06T 7/50: Depth or shape recovery - G06T 7/62: of area, perimeter, diameter or volume - G06V 20/52: Surveillance or monitoring of activities, e.g. for recognising suspicious objects (recognising microscopic objects G06V20/69) - G06V 40/172: {Classification, e.g. identification} - G07C 9/37: using biometric data, e.g. fingerprints, iris scans or voice recognition - E05F 2015/767: {using cameras} - E05Y 2400/45: Control modes - E05Y 2900/40: for gates - G06T 2207/30232: Surveillance - G07C: TIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE - E05B: LOCKS; ACCESSORIES THEREFOR; HANDCUFFS - E05F: DEVICES FOR MOVING WINGS INTO OPEN OR CLOSED POSITION; CHECKS FOR WINGS; WING FITTINGS NOT OTHERWISE PROVIDED FOR, CONCERNED WITH THE FUNCTIONING OF THE WING - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING - E05Y: INDEXING SCHEME ASSOCIATED WITH SUBCLASSES E05D AND E05F, RELATING TO CONSTRUCTION ELEMENTS, ELECTRIC CONTROL, POWER SUPPLY, POWER SIGNAL OR TRANSMISSION, USER INTERFACES, MOUNTING OR COUPLING, DETAILS, ACCESSORIES, AUXILIARY OPERATIONS NOT OTHERWISE PROVIDED FOR, APPLICATION THEREOF ## Abstract An information processing device of the present invention includes: a matching means that executes a matching process of performing matching between an object within a captured image obtained by capturing a pre-passing side region of a gate and a previously registered object; a distance estimating means that estimates a distance from the gate to the object within the captured image by using a reference value set based on an attribute of the object within the captured image; and a gate controlling means that controls opening and closing of the gate based on a result of the matching and the estimated distance to the object within the captured image. ## Claims ### Claim 1 An information processing device comprising a memory having processing instructions stored therein and at least one processor configured to execute the processing instructions, wherein the at least one processor is configured to: execute a matching process of performing matching between an object within a captured image obtained by capturing a pre-passing side region of a gate and a previously registered object; and also execute a process to estimate a distance from the gate to the object within the captured image by using a reference value set based on an attribute of the object within the captured image, and control opening and closing of the gate based on a result of the matching and the estimated distance to the object within the captured image. ### Claim 2 (depends on 1) The information processing device according to claim 1, wherein the at least one processor is configured to: execute the matching process based on the estimated distance to the object within the captured image; and execute a process to control the opening and closing of the gate based on a processing result of the matching process executed based on the distance to the object within the captured image. ### Claim 3 (depends on 2) The information processing device according to claim 2, wherein the at least one processor is configured to execute a process to identify an attribute of the object within the captured image based on an attribute analysis process on an image portion of the object, set the reference value corresponding to the attribute, and estimate the distance to the object within the captured image by using the set reference value. ### Claim 4 (depends on 1) The information processing device according to claim 1, wherein the at least one processor is configured to execute a process to identify an attribute of the previously registered object as an attribute of the object within the captured image from a result of the matching process, set the reference value corresponding to the attribute, and estimate the distance to the object within the captured image by using the set reference value. ### Claim 5 (depends on 4) The information processing device according to claim 4, wherein the at least one processor is configured to execute a process to, when failed in identifying the attribute of the object within the captured image from the result of the matching process, identify the attribute of the object within the captured image based on an attribute analysis process on an image portion of the object, set the reference value corresponding to the attribute, and estimate the distance to the object within the captured image by using the set reference value. ### Claim 6 (depends on 1) The information processing device according to claim 1, wherein the at least one processor is configured to execute a process to detect object information representing a feature of the object within the object image, and estimate the distance to the object within the captured image based on the reference value and the object information. ### Claim 7 (depends on 6) The information processing device according to claim 6, wherein the at least one processor is configured to execute a process to detect a size of a predetermined site of the object within the captured image as the object information, and estimate the distance to the object within the captured image based on the size of the predetermined site of the object with reference to the reference value. ### Claim 8 (depends on 7) The information processing device according to claim 7, wherein the at least one processor is configured to execute a process to compare sizes of predetermined sites of respective objects within the identical captured image with reference to reference values set corresponding to the objects, with each other, and determine a perspective relation between the objects within the captured image with reference to the gate. ### Claim 9 (depends on 1) The information processing device according to claim 1, wherein the at least one processor is configured to execute a process to control the opening and closing of the gate based on the result of the matching on the object within the captured image and the distance from the gate to the object, the result and the distance being associated with each other for the object. ### Claim 10 (canceled) ### Claim 11 A non-transitory computer-readable storage medium having a program stored therein, the program comprising instructions for causing an information processing device to realize: a matching unit that executes a matching process of performing matching between an object within a captured image obtained by capturing a pre-passing side region of a gate and a previously registered object; a distance estimating unit that estimates a distance from the gate to the object within the captured image by using a reference value set based on an attribute of the object within the captured image; and a gate controlling unit that controls opening and closing of the gate based on a result of the matching and the estimated distance to the object within the captured image. ### Claim 12 An information processing method comprising: executing a matching process of performing matching between an object within a captured image obtained by capturing a pre-passing side region of a gate and a previously registered object; and also estimating a distance from the gate to the object within the captured image by using a reference value set based on an attribute of the object within the captured image; and controlling opening and closing of the gate based on a result of the matching and the estimated distance to the object within the captured image. ### Claim 13 (depends on 12) The information processing method according to claim 12, comprising: executing the matching process based on the estimated distance to the object within the captured image; and controlling the opening and closing of the gate based on a processing result of the matching process executed based on the distance to the object within the captured image. ### Claim 14 (depends on 12) The information processing method according to claim 12, comprising: identifying an attribute of the previously registered object as an attribute of the object within the captured image from a result of the matching process, and setting the reference value corresponding to the attribute; estimating the distance to the target within the captured image by using the reference value; and controlling the opening and closing of the gate based on the distance to the object within the captured image. ### Claim 15 (depends on 14) The information processing method according to claim 14, comprising: when identifying the attribute of the object within the captured image from the result of the matching process fails, identifying the attribute of the object within the captured image based on an attribute analysis process on an image portion of the object, and setting the reference value corresponding to the attribute; estimating the distance to the object within the captured image by using the reference value; and controlling the opening and closing of the gate based on the estimated distance to the object within the captured image.