# US 2025/0166482 A1 · System and device for threat monitoring

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0166482 A1
- Document ID: US20250166482A1
- Status: Published application
- Kind: A1
- Application number: 18/516,866
- Filed: 2023-11-21
- Published: 2025-05-22
- Earliest claimed: 2023-11-21
- Assignees: Schon Mobility Inc.
- Applicants: Schon Mobility Inc.
- Inventors: Vishnu Gurusamy Sundaram; Krishna Swetha Meka
- Web page: https://patentgrep.com/patent/US20250166482A1

## CPC

- G08B 21/182: {Level alarms, e.g. alarms responsive to variables exceeding a threshold}
- G01S 7/003: {Transmission of data between radar, sonar or lidar systems and remote stations}
- G01S 13/867: {Combination of radar systems with cameras}
- G01S 13/88: Radar or analogous systems specially adapted for specific applications (electromagnetic prospecting or detecting of objects, e.g. near-field detection, G01V3/00)
- G01S 13/89: for mapping or imaging
- G01S 13/931: of land vehicles
- G02B 27/017: {Head mounted}
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06T 7/50: Depth or shape recovery
- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- G08B 3/00: Audible signalling systems, e.g. audible personal calling systems
- G08B 5/00: Visible signalling systems, e.g. visible personal calling systems or remote indication of seats occupied
- G08B 6/00: Tactile signalling systems, e.g. tactile personal calling systems
- G08B 7/06: using electric transmission {, e.g. involving audible and visible signalling through the use of sound and light sources}
- G08B 21/02: Alarms for ensuring the safety of persons
- H04L 67/306: User profiles
- H04W 4/40: for vehicles, e.g. vehicle-to-pedestrians [V2P]
- G01S 7/027: {Constructional details of housings, e.g. form, type, material or ruggedness}
- G01S 7/4813: {Housing arrangements}
- G01S 17/88: Lidar systems specially adapted for specific applications
- G01S 2013/9316: {combined with communication equipment with other vehicles or with base stations}
- G01S 2013/9323: {Alternative operation using light waves}
- G08B: SIGNALLING SYSTEMS, e.g. PERSONAL CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G01S: RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)
- H04W: WIRELESS COMMUNICATION NETWORKS (broadcast communication H04H; communication systems using wireless links for non-selective communication, e.g. wireless extensions H04M1/72)

## Abstract

A system and a device for active threat monitoring in a user worn helmet is provided. The system comprises an Internet of Things (IoT) cloud server having an IoT database. The IoT database is configured to generate virtual data feed. The system comprises a head mounted wearable device. The head mounted wearable device comprises a plurality of physical sensors configured to sense and generate at least one of visual feed and radar feed and a multimodal communication interface. The system comprises a user database designated to store user profile data. The system comprises an environment monitoring unit configured to map an environment based on at least of one of the visual feed, the radar feed, and the virtual data. The system comprises an awareness unit configured to generate an environmental context based on position of a user. The system comprises a controller. The controller is configured to receive the user profile data from the user database, the mapped environment from the environment monitoring unit, the environment context from the awareness unit, and the virtual data feed from the IoT database; analyse the user profile data, the visual feed and the radar feed, the environment context, and the virtual data feed to predict occurrence of threat based on the analysed data; and warn the user about a threat based on the predicted occurrence of the threat via the multimodal communication interface.

## Claims

### Claim 1

A threat monitoring system, comprising:
a controller;
an Internet of Things (IoT) cloud server having an IoT database, wherein the IoT database is configured to generate virtual data feed;
a head mounted wearable device comprising:
a plurality of physical sensors configured to sense and generate at least one of visual feed and radar feed, and
a multimodal communication interface;
a user database configured to store user profile data;
an environment monitoring unit configured to map an environment based on at least of one of the visual feed, the radar feed, and the virtual data feed; and
an awareness unit configured to generate an environmental context based on position of a user,
wherein the controller is configured to:
receive the user profile data from the user database, the visual feed and the radar feed from the plurality of physical sensors, the mapped environment from the environment monitoring unit, the environment context from the awareness unit, and the virtual data feed from the IoT database;
analyse the user profile data, the visual feed and the radar feed, the environment context, and the virtual data feed to predict occurrence of threat; and
warn the user about a threat based on the predicted occurrence of the threat via the multimodal communication interface.

### Claim 2 (depends on 1)

The system as claimed in claim 1, wherein the controller, the user database, the environment monitoring unit, and the awareness unit are disposed in the head mounted wearable device.

### Claim 3 (depends on 1)

The system as claimed in claim 1, wherein the controller, the user database, the environment monitoring unit, the awareness unit, and the multimodal communication interface are operationally configured in a user device.

### Claim 4 (depends on 1)

The system as claimed in claim 1, wherein the plurality of physical sensors comprises at least one of a front camera, a rear camera, side cameras, an aerial camera, a 360° view camera, and a radar.

### Claim 5 (depends on 4)

The system as claimed in claim 4, wherein the front camera is mounted in the head mounted wearable device facing towards the user for monitoring awareness, attention, and glanced based information of the user.

### Claim 6 (depends on 4)

The system as claimed in claim 4, wherein the 360° view camera is configured to capture images for performing depth detection and for sending the captured images to the IoT cloud server.

### Claim 7 (depends on 1)

The system as claimed in claim 1, wherein the virtual data feed at the IoT server is received from IoT devices.

### Claim 8 (depends on 1)

The system as claimed in claim 1, wherein the virtual data feed comprises cloud-based data, wherein the cloud-based data comprises at least one of weather data, historical data, data on amount of light falling on the user's eyes, SOS alert information, environmental data, and data received from other users.

### Claim 9 (depends on 1)

The system as claimed in claim 1, wherein the virtual data feed comprises peer to peer communication data, wherein the peer to peer communication data comprises vehicle to everything (V2X) data received from peer devices.

### Claim 10 (depends on 9)

The system as claimed in claim 9, wherein the controller is further configured to process the threat based on the analysed data and transmits the processed threat data over V2X (vehicle to everything) communication to the peer devices.

### Claim 11 (depends on 1)

The system as claimed in claim 1, wherein the multimodal communication interface is configured to receive multimodal states related to the user for intent detection thereof.

### Claim 12 (depends on 11)

The system as claimed in claim 11, wherein the multimodal states comprise at least one of user's speech, gesture, touch, brainwave, gaze, pupil movement, head movement and body movement.

### Claim 13 (depends on 11)

The system as claimed in claim 11, wherein the multimodal communication interface warns the user with directionality and intensity of the warning via multimodal communication.

### Claim 14 (depends on 11)

The system as claimed in claim 11, wherein the multimodal communication comprises at least one of bone conduction communication, visual and audible communication, augmented reality projection, virtual reality projection, and stationary display.

### Claim 15 (depends on 1)

The system as claimed in claim 1, wherein the controller is further configured to determine a threshold level for warning the user, wherein the user is warned if the predicted occurrence of the threat is greater than the determined threshold level.

### Claim 16

A head mounted wearable device for threat monitoring in communication with an Internet of Things (IoT) cloud server having an IoT database, wherein the IoT database is configured to generate virtual data feed, the head mounted wearable device comprising:
a plurality of physical sensors configured to sense and generate at least one of visual feed and radar feed;
a user database configured to store user profile data;
an environment monitoring unit configured to map an environment based on at least of one of the visual feed, the radar feed, and the virtual data feed;
an awareness unit configured to generate an environmental context based on position of a user;
a multimodal communication interface; and
a controller configured to:
receive the user profile data from the user database, the visual feed and the radar feed from the plurality of physical sensors, the mapped environment from the environment monitoring unit, the environment context from the awareness unit, and the virtual data feed from the IoT database;
analyse the user profile data, the visual feed and the radar feed, the environment context, and the virtual data feed to predict occurrence of threat; and
warn the user about a threat based on the predicted occurrence of the threat via the multimodal communication interface.

### Claim 17 (depends on 16)

The device as claimed in claim 16, wherein the plurality of physical sensors comprises at least one of a front camera, a rear camera, side cameras, an aerial camera, a 360° view camera, and a radar.

### Claim 18 (depends on 16)

The device as claimed in claim 16, wherein the virtual data feed at the IoT server is received from IoT devices.

### Claim 19 (depends on 16)

The device as claimed in claim 16, wherein the virtual data feed comprises cloud-based data, wherein the cloud-based data comprises at least one of weather data, historical data, data on amount of light falling on the user's eyes, SOS alert information, environmental data, and data received from other users.

### Claim 20 (depends on 16)

The device as claimed in claim 16, wherein the virtual data feed comprises peer to peer communication data, wherein the peer to peer communication data comprises vehicle to everything (V2X) data received from peer devices.

### Claim 21 (depends on 20)

The device as claimed in claim 20, wherein the controller is further configured to process the threat based on the analysed data and transmits the processed threat data over V2X (vehicle to everything) communication to the peer devices.

### Claim 22 (depends on 16)

The device as claimed in claim 16, wherein the multimodal communication interface is configured to receive multimodal states related to the user for intent detection thereof.

### Claim 23 (depends on 22)

The device as claimed in claim 22, wherein the multimodal communication interface warns the user with directionality and intensity of the warning via multimodal communication.

### Claim 24 (depends on 22)

The device as claimed in claim 22, wherein the multimodal communication comprises at least one of bone conduction communication, visual and audible communication, augmented reality projection, virtual reality projection, and stationary display.

### Claim 25 (depends on 16)

The device as claimed in claim 16, wherein the device is used by at least one of a biker, a mining worker, a road worker, and a sportsperson.
