Systems, methods, and storage media for multi-modal sensing and monitoring

A method for multi-modal sensing and monitoring, comprising:

• determining an operational mode in which a signal emission node and a signal reception node perform communication-based sensing on a target object;
• obtaining at least one of an emission signal emitted from the signal emission node, a signal reception delay at the signal reception node, a Doppler frequency shift of a signal travelling round-trip between the signal emission node and the signal reception node, and a reception angle;
• obtaining a reception signal at the signal reception node based on at least one of the emission signal, the signal reception delay, the Doppler frequency shift, and the reception angle;
• obtaining a sensing spectrum based on the reception signal;
• determining, based on the sensing spectrum, a sensing and monitoring result of the target object, wherein the sensing and monitoring result includes at least one of a location, a confidence level, and a class of the target object;
• and
• at each of a plurality of target time points:
• determining a confidence drop value corresponding to target time point based on an average confidence level corresponding to the target time point and an average confidence level corresponding to a previous target time point;
• in response to the confidence drop value at the target time point being greater than a preset threshold, updating a signal emission parameter and a signal reception parameter at the target time point, generating a signal emission instruction and a signal reception instruction based on the updated signal emission parameter and the updated signal reception parameter, and sending the signal emission instruction and the signal reception instruction to the signal emission node and the signal reception node, respectively, wherein the signal emission instruction controls the signal emission node to emit the emission signal, and the signal reception instruction controls the signal reception node to receive the reception signal;
• and
• generating a target location at the target time point, and generating a movement instruction based on the target location, the movement instruction controlling a movement of the communication mobile station.

A non-transitory computer-readable storage medium, wherein the storage medium stores computer instructions, and when a computer reads the computer instructions in the storage medium, the computer executes a method for multi-modal sensing and monitoring, the method comprising:

• determining an operational mode in which a signal emission node and a signal reception node perform communication-based sensing on a target object;
• obtaining at least one of an emission signal emitted from the signal emission node, a signal reception delay at the signal reception node, a Doppler frequency shift, and a reception angle at which the signal makes a round trip between the signal emission node and the signal reception node;
• obtaining a reception signal at the signal reception node based on at least one of the emission signal, the signal reception delay, the Doppler frequency shift, and the reception angle;
• obtaining a sensing spectrum based on the reception signal;
• and
• determining, based on the sensing spectrum, a sensing and monitoring result of the target object, wherein the sensing and monitoring result includes at least one of a location, a confidence level, and a class of the target object;
• and
• at each of a plurality of target time points:
• determining a confidence drop value corresponding to target time point based on an average confidence level corresponding to the target time point and an average confidence level corresponding to a previous target time point;
• in response to the confidence drop value at the target time point being greater than a preset threshold, updating a signal emission parameter and a signal reception parameter at the target time point, generating a signal emission instruction and a signal reception instruction based on the updated signal emission parameter and the updated signal reception parameter, and sending the signal emission instruction and the signal reception instruction to the signal emission node and the signal reception node, respectively, wherein the signal emission instruction controls the signal emission node to emit the emission signal, and the signal reception instruction controls the signal reception node to receive the reception signal;
• and
• generating a target location at the target time point, and generating a movement instruction based on the target location, the movement instruction controlling a movement of the communication mobile station.