# US 2021/0345286 A1 · Sensor information integration system, sensor information integration method, program, and recording medium > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2021/0345286 A1 - Document ID: US20210345286A1 - Status: Published application - Kind: A1 - Application number: 17/284,609 - Filed: 2019-10-09 - Published: 2021-11-04 - Earliest claimed: 2018-10-29 - Assignees: NEC Corporation - Applicants: NEC Corporation - Inventors: Toshiki TAKEUCHI - Web page: https://patentgrep.com/patent/US20210345286A1 ## CPC - G01S 13/88: Radar or analogous systems specially adapted for specific applications (electromagnetic prospecting or detecting of objects, e.g. near-field detection, G01V3/00) - H04W 64/00: Locating users or terminals {or network equipment} for network management purposes, e.g. mobility management - G01B 21/00: Measuring arrangements or details thereof, where the measuring technique is not covered by the other groups of this subclass, unspecified or not relevant - G01S 13/867: {Combination of radar systems with cameras} - G06T 7/20: Analysis of motion (motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51) - G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80) - H04W 4/029: Location-based management or tracking services - G01S: RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES - H04W: WIRELESS COMMUNICATION NETWORKS (broadcast communication H04H; communication systems using wireless links for non-selective communication, e.g. wireless extensions H04M1/72) - G01B: MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL ## Abstract The present invention is designed to make it possible to draw proper associations, when integrating pieces of information estimated in individual sensors, by associating between objects sensed by a plurality of sensors. A sensor information integration system 101 includes a radio frame analyzing section 33 configured to analyze a radio frame transmitted from a first object, to extract the first attribute information, an image analyzing section 40 configured to analyze an image, in which a second object is sensed, to extract second attribute information, and an association judging section 21 configured to judge an association between the first object and the second object, using the first attribute information and the second attribute information. ## Claims ### Claim 1 A sensor information integration system comprising: a memory storing instructions; and one or more processors configured to execute the instructions to: analyze a radio frame transmitted from a first object, to extract first attribute information related to the first object; analyze an image, in which a second object is sensed, to extract second attribute information related to the second object, from a plurality of pieces of attribute information given based on at least one of a plurality of images and information of one or more objects; and judge an association between the first object and the second object, using the first attribute information and the second attribute information. ### Claim 2 (depends on 1) The sensor information integration system according to claim 1, wherein the one or more processors are further configured to execute the instructions to integrate identification information of an object to be sensed, by using a result of judging the association in the association judging unit, the first attribute information, and the second attribute information. ### Claim 3 (depends on 1) The sensor information integration system according to claim 1, wherein the one or more processors are further configured to execute the instructions to: estimate location information of the first object from a radio wave; and estimate location information of the second object from an image, and wherein the association judging unit is configured to judge the association between the first object and the second object, further using the location information of the first object and the location information of the second object. ### Claim 4 (depends on 3) The sensor information integration system according to claim 3, wherein the one or more processors are further configured to execute the instructions to integrate location information of the object to be sensed, by using the result of judging the association in the association judging unit, the location information of the first object, and the location information of the second object. ### Claim 5 (depends on 3) The sensor information integration system according to claim 3, wherein the one or more processors are configured to execute the instructions to: calculate a similarity between the first attribute information and the second attribute information; and calculate a distance between the first object and the second object based on the location information of the first object and the location information of the second object. ### Claim 6 (depends on 5) The sensor information integration system according to claim 5, wherein the one or more processors are further configured to execute the instructions to perform weighted synthesis of the similarity and the distance, using accuracy information of location estimation given based on the location information of the first object and the location information of the second object. ### Claim 7 (depends on 5) The sensor information integration system according to claim 5, wherein distance axes in the distances calculated in the distance calculation unit include axes of at least two of an angular direction, a depth direction, and an altitude direction. ### Claim 8 (depends on 1) The sensor information integration system according to claim 1, wherein the first attribute information includes at least one of: information related to an entity in which the first object is installed; information related to a communication node to which the radio frame is transmitted; and information related to a communication operation of the first object. ### Claim 9 (depends on 8) The sensor information integration system according to claim 8, wherein the information related to the entity with the first object installed includes at least one of: information indicating a type of the entity; information related to a model name or a manufacturing vendor of the entity; and information related to a country of manufacture or a country of destination of the entity. ### Claim 10 (depends on 8) The sensor information integration system according to claim 8, wherein the information related to the communication node to which the radio frame is transmitted includes information related to hub station or a terminal station for a sensor network. ### Claim 11 (depends on 8) The sensor information integration system according to claim 8, wherein the information related to the communication operation of the first object includes information related to an operation of any one of standby, operating, and talking. ### Claim 12 (depends on 1) The sensor information integration system according to claim 1, wherein the second attribute information includes at least one of: information identifying the second object; information related to a communication operation of the second object; and information related to an arrangement of an antenna attached to the second object. ### Claim 13 (depends on 12) The sensor information integration system according to claim 12, wherein the information identifying the second object includes information indicating a type of the second object, and information related to at least one of an age, sex, and birthplace of a person. ### Claim 14 (depends on 12) The sensor information integration system according to claim 12, wherein the information related to the communication operation of the second object includes information related to an operation of any one of standby, operating, and talking. ### Claim 15 (depends on 12) The sensor information integration system according to claim 12, wherein the information related to the arrangement of the antenna attached to the second object includes information related to extension or storage of the antenna. ### Claim 16 A sensor information integration method comprising: analyzing a radio frame transmitted from a first object, to extract first attribute information related to the first object; analyzing an image, in which a second object is sensed, to extract second attribute information related to the second object, from a plurality of pieces of attribute information given based on at least one of a plurality of images and information of one or more objects; and judging an association between the first object and the second object, using the first attribute information and the second attribute information. ### Claim 17 (canceled) ### Claim 18 A non-transitory computer readable recording medium storing a program that causes a processor to execute: analyzing a radio frame transmitted from a first object, to extract first attribute information related to the first object; analyzing an image, in which a second object is sensed, to extract second attribute information related to the second object, from a plurality of pieces of attribute information given based on at least one of a plurality of images and information of one or more objects; and judging an association between the first object and the second object, using the first attribute information and the second attribute information.