# US 2025/0095655 A1 · Identity recognition method, apparatus, computer device, and storage medium

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0095655 A1
- Document ID: US20250095655A1
- Status: Published application
- Kind: A1
- Application number: 18/509,329
- Filed: 2023-11-15
- Published: 2025-03-20
- Earliest claimed: 2023-09-18
- Assignees: ZJU-Hangzhou Global Scientific and Technological Innovation Center
- Applicants: Zju-Hangzhou Global Scientific and Technological Innovation Center
- Inventors: Feng LIN; Tiantian LIU; Chao WANG; Hao YAN; Kui REN
- Web page: https://patentgrep.com/patent/US20250095655A1

## CPC

- G01S 13/86: Combinations of radar systems with non-radar systems, e.g. sonar, direction finder
- G10L 17/10: Multimodal systems, i.e. based on the integration of multiple recognition engines or fusion of expert systems
- G01S 7/41: using analysis of echo signal for target characterisation; Target signature; Target cross-section
- G01S 13/32: using transmission of continuous waves, whether amplitude-, frequency-, or phase-modulated, or unmodulated
- G06F 18/25: Fusion techniques
- G10L 17/02: Preprocessing operations, e.g. segment selection; Pattern representation or modelling, e.g. based on linear discriminant analysis [LDA] or principal components; Feature selection or extraction
- G10L 17/20: Pattern transformations or operations aimed at increasing system robustness, e.g. against channel noise or different working conditions
- G10L 21/0232: Processing in the frequency domain
- G10L 25/78: Detection of presence or absence of voice signals (switching of direction of transmission by voice frequency in two-way loud-speaking telephone systems H04M9/10)
- Y02D 30/70: in wireless communication networks
- G01S: RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- Y02D: CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE

## Abstract

An identity recognition method, an apparatus, a computer device, and a storage medium are provided. The method includes: obtaining a signal to be identified which includes a millimeter wave signal and an audio signal; performing living feature detection based on the millimeter wave signal and the audio signal, and acquiring a living millimeter wave signal and a living audio signal; performing feature fusion of the living millimeter wave signal and the living audio signal, and acquiring a fusion response diagram of a living voice signal; and performing identity recognition based on the fusion response diagram of the living voice signal.

## Claims

### Claim 1

An identity recognition method, comprising:
obtaining a signal to be identified which comprises a millimeter wave signal and an audio signal;
performing living feature detection based on the millimeter wave signal and the audio signal, and acquiring a living millimeter wave signal and a living audio signal;
performing feature fusion of the living millimeter wave signal and the living audio signal, and acquiring a fusion response diagram of a living voice signal; and
performing identity recognition based on the fusion response diagram of the living voice signal.

### Claim 2 (depends on 1)

The identity recognition method of claim 1, wherein before the performing living feature detection based on the millimeter wave signal and the audio signal, and acquiring the living millimeter wave signal and the living audio signal, the method further comprises:
performing voice activity detection of the millimeter wave signal and the audio signal, and acquiring a millimeter wave signal and an audio signal with voice activity; and
performing denoising of the millimeter wave signal and the audio signal with voice activity, and acquiring a denoised millimeter wave signal and a denoised audio signal.

### Claim 3 (depends on 2)

The identity recognition method of claim 2, wherein the performing voice activity detection of the millimeter wave signal and the audio signal, and acquiring the millimeter wave signal and the audio signal with voice activity further comprises:
sampling the millimeter wave signal and the audio signal, and acquiring sampled millimeter wave signals and sampled audio signals;
obtaining a phase of the sampled millimeter wave signals and determining phase difference between sampled millimeter wave signals with the same frequency; and
performing low-pass filtering based on the phase difference and the sampled audio signals, and acquiring the millimeter wave signal and the audio signal with voice activity.

### Claim 4 (depends on 2)

The identity recognition method of claim 2, wherein the performing denoising of the millimeter wave signal and the audio signal with voice activity, and acquiring the denoised millimeter wave signal and the denoised audio signal further comprises:
decomposing the millimeter wave signal and the audio signal with voice activity, and acquiring millimeter wave sub-signals and audio sub-signals;
calculating correlation based on the millimeter wave sub-signals and the audio sub-signals, and screening the millimeter wave sub-signals and the audio sub-signals based on the correlation; and
recombining screened millimeter wave sub-signals and screened audio sub-signals, and acquiring the denoised millimeter wave signal and the denoised audio signal.

### Claim 5 (depends on 1)

The identity recognition method of claim 1, wherein the performing living feature detection based on the millimeter wave signal and the audio signal, and acquiring the living millimeter wave signal and the living audio signal further comprises:
extracting living feature of millimeter wave and living feature of audio based on the millimeter wave signal and the audio signal, respectively;
calculating similarity coefficients based on the living feature of millimeter wave and the living feature of audio, and generating a dual-mode reference signal based on the similarity coefficients; and
inputting the dual-mode reference signal into a classification model, and acquiring the living millimeter wave signal and the living audio signal, wherein the classification model is trained by using a standard data set.

### Claim 6 (depends on 1)

The identity recognition method of claim 1, wherein the performing feature fusion of the living millimeter wave signal and the living audio signal, and acquiring the fusion response diagram of the living voice signal further comprises:
generating a millimeter wave response diagram and an audio response diagram based on the living millimeter wave signal and the living audio signal, respectively; and
fusing the millimeter wave response diagram and the audio response diagram, and acquiring the fusion response diagram of the living voice signal.

### Claim 7 (depends on 1)

The identity recognition method of claim 1, wherein the performing identity recognition based on the fusion response diagram of the living voice signal further comprises:
inputting the fusion response diagram of the living voice signal into an identity recognition network, and acquiring an identity label of the user, wherein the identity recognition network comprises a channel attention module and a spatial attention module.

### Claim 8

An identity recognition apparatus, comprising:
means for obtaining a signal to be identified which comprises a millimeter wave signal and an audio signal;
means for performing living feature detection based on the millimeter wave signal and the audio signal, and acquiring a living millimeter wave signal and a living audio signal;
means for performing feature fusion of the living millimeter wave signal and the living audio signal, and acquiring a fusion response diagram of a living voice signal; and
means for performing identity recognition based on the fusion response diagram of the living voice signal.

### Claim 9 (depends on 1)

A computer device, comprising a processor and a memory, the memory storing a computer program, wherein the computer program is executable by the processor to implement the steps of the identity recognition method of claim 1.

### Claim 10 (depends on 9)

The computer device of claim 9, wherein before the performing living feature detection based on the millimeter wave signal and the audio signal, and acquiring the living millimeter wave signal and the living audio signal, the method further comprises:
performing voice activity detection of the millimeter wave signal and the audio signal, and acquiring a millimeter wave signal and an audio signal with voice activity; and
performing denoising of the millimeter wave signal and the audio signal with voice activity, and acquiring a denoised millimeter wave signal and a denoised audio signal.

### Claim 11 (depends on 10)

The computer device of claim 10, wherein the performing voice activity detection of the millimeter wave signal and the audio signal, and acquiring the millimeter wave signal and the audio signal with voice activity further comprises:
sampling the millimeter wave signal and the audio signal, and acquiring sampled millimeter wave signals and sampled audio signals;
obtaining a phase of the sampled millimeter wave signals and determining phase difference between sampled millimeter wave signals with the same frequency; and
performing low-pass filtering based on the phase difference and the sampled audio signals, and acquiring the millimeter wave signal and the audio signal with voice activity.

### Claim 12 (depends on 10)

The computer device of claim 10, wherein the performing denoising of the millimeter wave signal and the audio signal with voice activity, and acquiring the denoised millimeter wave signal and the denoised audio signal further comprises:
decomposing the millimeter wave signal and the audio signal with voice activity, and acquiring millimeter wave sub-signals and audio sub-signals;
calculating correlation based on the millimeter wave sub-signals and the audio sub-signals, and screening the millimeter wave sub-signals and the audio sub-signals based on the correlation; and
recombining screened millimeter wave sub-signals and screened audio sub-signals, and acquiring the denoised millimeter wave signal and the denoised audio signal.

### Claim 13 (depends on 9)

The computer device of claim 9, wherein the performing living feature detection based on the millimeter wave signal and the audio signal, and acquiring the living millimeter wave signal and the living audio signal further comprises:
extracting living feature of millimeter wave and living feature of audio based on the millimeter wave signal and the audio signal, respectively;
calculating similarity coefficients based on the living feature of millimeter wave and the living feature of audio, and generating a dual-mode reference signal based on the similarity coefficients; and
inputting the dual-mode reference signal into a classification model, and acquiring the living millimeter wave signal and the living audio signal, wherein the classification model is trained by using a standard data set.

### Claim 14 (depends on 9)

The computer device of claim 9, wherein the performing feature fusion of the living millimeter wave signal and the living audio signal, and acquiring the fusion response diagram of the living voice signal further comprises:
generating a millimeter wave response diagram and an audio response diagram based on the living millimeter wave signal and the living audio signal, respectively; and
fusing the millimeter wave response diagram and the audio response diagram, and acquiring the fusion response diagram of the living voice signal.

### Claim 15 (depends on 9)

The computer device of claim 9, wherein the performing identity recognition based on the fusion response diagram of the living voice signal further comprises:
inputting the fusion response diagram of the living voice signal into an identity recognition network, and acquiring an identity label of the user, wherein the identity recognition network comprises a channel attention module and a spatial attention module.

### Claim 16 (depends on 1)

A computer-readable storage medium having stored a computer program, wherein the computer program is executable by a processor to implement the steps of the identity recognition method of claim 1.

### Claim 17 (depends on 16)

The computer-readable storage medium of claim 16, wherein before the performing living feature detection based on the millimeter wave signal and the audio signal, and acquiring the living millimeter wave signal and the living audio signal, the method further comprises:
performing voice activity detection of the millimeter wave signal and the audio signal, and acquiring a millimeter wave signal and an audio signal with voice activity; and
performing denoising of the millimeter wave signal and the audio signal with voice activity, and acquiring a denoised millimeter wave signal and a denoised audio signal.

### Claim 18 (depends on 17)

The computer-readable storage medium of claim 17, wherein the performing voice activity detection of the millimeter wave signal and the audio signal, and acquiring the millimeter wave signal and the audio signal with voice activity further comprises:
sampling the millimeter wave signal and the audio signal, and acquiring sampled millimeter wave signals and sampled audio signals;
obtaining a phase of the sampled millimeter wave signals and determining phase difference between sampled millimeter wave signals with the same frequency; and
performing low-pass filtering based on the phase difference and the sampled audio signals, and acquiring the millimeter wave signal and the audio signal with voice activity.

### Claim 19 (depends on 17)

The computer-readable storage medium of claim 17, wherein the performing denoising of the millimeter wave signal and the audio signal with voice activity, and acquiring the denoised millimeter wave signal and the denoised audio signal further comprises:
decomposing the millimeter wave signal and the audio signal with voice activity, and acquiring millimeter wave sub-signals and audio sub-signals;
calculating correlation based on the millimeter wave sub-signals and the audio sub-signals, and screening the millimeter wave sub-signals and the audio sub-signals based on the correlation; and
recombining screened millimeter wave sub-signals and screened audio sub-signals, and acquiring the denoised millimeter wave signal and the denoised audio signal.

### Claim 20 (depends on 16)

The computer-readable storage medium of claim 16, wherein the performing living feature detection based on the millimeter wave signal and the audio signal, and acquiring the living millimeter wave signal and the living audio signal further comprises:
extracting living feature of millimeter wave and living feature of audio based on the millimeter wave signal and the audio signal, respectively;
calculating similarity coefficients based on the living feature of millimeter wave and the living feature of audio, and generating a dual-mode reference signal based on the similarity coefficients; and
inputting the dual-mode reference signal into a classification model, and acquiring the living millimeter wave signal and the living audio signal, wherein the classification model is trained by using a standard data set.
