# US 12,112,439 B2 · Systems and methods for immersive and collaborative video surveillance > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,112,439 B2 - Document ID: US12112439B2 - Status: Granted - Kind: B2 - Application number: 17/831,538 - Filed: 2022-06-03 - Published: 2022-09-22 - Granted: 2024-10-08 - Earliest claimed: 2016-06-30 - Assignees: Honeywell International Inc. - Applicants: Honeywell International Inc. - Inventors: MuthuRamji Vadamalayan; Deepakumar Subbian; Kathiresan Periyasamy - Web page: https://patentgrep.com/patent/US12112439B2 ## CPC - G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)} - G08B 13/19678: {User interface} - H04N 7/183: {for receiving images from a single remote source} - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - G08B: SIGNALLING SYSTEMS, e.g. PERSONAL CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract Systems and methods for immersive and collaborative video surveillance, in the commercial security industry are provided. Some methods can include receiving a video data stream from a surveillance camera in a monitored region via a cloud network, a user interface device of or coupled to a virtual reality headset displaying the video data stream, and the user interface device receiving user input corresponding to a movement of a user's body to navigate the video data stream and simulate the user navigating the monitored region from within the monitored region. ## Claims ### Claim 1 A method for monitoring a surveillance system of a facility having a plurality of surveillance devices including one or more access control devices, one or more intrusion detection devices and a plurality of video surveillance cameras, the method comprising: receiving a selection of one of the plurality of video surveillance cameras; receiving a video data stream captured by the selected video surveillance camera, wherein the selected video surveillance camera has a field of view that includes a corresponding monitored region of the facility; a first user interface device of a first virtual reality headset displaying: the video data stream to a first user; and a status of one or more of the plurality of surveillance devices; the first user interface device receiving a first user input corresponding to a movement of at least part of the first user's body; the first user interface device simulating the first user navigating the monitored region from within the monitored region by adjusting a presentation of the video data stream received from the surveillance camera in the monitored region in response to the first user input; a second user interface device, remote from the first user interface device, displaying: at least part of the video data stream that is displayed on the first user interface device presented from the same perspective as the video data stream is presented on the first user interface device, resulting in a common scene; and the status of the one or more of the plurality of surveillance devices; and the first user interface device transmitting and receiving audio communication signals to and from the second user interface device to allow the first user of the first user interface device and a second user of the second user interface device to investigate a security incident captured by the surveillance system by collaboratively discussing events observed in the common scene. ### Claim 2 (depends on 1) The method of claim 1, wherein the second user interface device is part of a second virtual reality headset. ### Claim 3 (depends on 1) The method of claim 1, wherein the audio communication signals are transmitted and received via a cloud network. ### Claim 4 (depends on 3) The method of claim 3, wherein the first user interface device of the first virtual reality headset receives the video data stream via the cloud network. ### Claim 5 (depends on 1) The method of claim 1, wherein the selected video surveillance camera is a 360 degree video surveillance camera. ### Claim 6 (depends on 1) The method of claim 1, wherein the first user interface device displays the video data stream overlaid on a representation of a BIM model or a floorplan of the monitored region. ### Claim 7 (depends on 1) The method of claim 1, wherein the video data stream is a recorded video data stream. ### Claim 8 (depends on 1) The method of claim 1, wherein the video data stream is a live video data stream. ### Claim 9 A method for monitoring a surveillance system of a facility having a plurality of surveillance devices including one or more access control devices, one or more intrusion detection devices and a plurality of video surveillance cameras, the method comprising: receiving a selection of one of the plurality of video surveillance cameras; receiving a video data stream captured by the selected video surveillance camera via a cloud network, wherein the selected video surveillance camera has a field of view that includes a corresponding monitored region of the facility; a first mobile device receiving the video data stream via the cloud network and displaying the video data stream to a first user; the first mobile device receiving a status of one or more of the plurality of surveillance devices and displaying the status of one or more of the plurality of surveillance devices to the first user; the first mobile device receiving a first user input from the first user that controls the display of the video data stream on the first mobile device; a second mobile device, remote from the first mobile device, receiving the video data stream via the cloud network and displaying at least part of the video data stream that is displayed on the first mobile device to a second user; the second mobile device receiving the status of one or more of the plurality of surveillance devices and displaying the status of one or more of the plurality of surveillance devices to the second user; and the first mobile device and the second mobile device transmitting and receiving communication signals via the cloud network to support communications between the first user of the first mobile device and a second user of the second mobile device to collaborate while investigating events observed in the video data stream. ### Claim 10 (depends on 9) The method of claim 9, wherein the first mobile device is part of a first virtual reality headset. ### Claim 11 (depends on 10) The method of claim 10, wherein the first user input from the first user comprises a movement of the first user's body captured by the first virtual reality headset. ### Claim 12 (depends on 9) The method of claim 9, wherein the second mobile device is part of a second virtual reality headset. ### Claim 13 (depends on 9) The method of claim 9, wherein the first mobile device is located in the corresponding monitored region, and the second mobile device is located remote from the corresponding monitored region. ### Claim 14 (depends on 9) The method of claim 9, wherein the video data stream is a recorded video data stream previously captured by the selected video surveillance camera. ### Claim 15 (depends on 9) The method of claim 9, wherein the video data stream is a live video data stream captured by the selected video surveillance camera. ### Claim 16 A surveillance system having a plurality of surveillance devices including one or more access control devices, one or more intrusion detection devices and a plurality of video surveillance cameras, the system comprising: a primary mobile device; a secondary mobile device remote from the primary mobile device; wherein the primary mobile device receives via a cloud network at least part of a video data stream captured by a selected one of the plurality of video surveillance cameras located in a monitored region, and displays at least part of the received video data stream on the primary mobile device as well as a status of one or more of a plurality of surveillance devices; wherein the secondary mobile device receives via the cloud network at least part of the video data stream captured by the selected one of the plurality of video surveillance cameras and displays: at least part of the video data stream that is displayed on the primary mobile device in the same manner that the video data stream is displayed on the primary mobile device, resulting in a shared video data stream; and the status of the one or more of the plurality of surveillance devices; the primary mobile device and the secondary mobile device configured to transmit and receive communication signals to support communications between the primary user of the primary mobile device and a secondary user of the secondary mobile device to collaborate while investigating events observed in the shared video data stream. ### Claim 17 (depends on 16) The system of claim 16, wherein the primary mobile device comprises a primary virtual reality headset. ### Claim 18 (depends on 17) The system of claim 17, wherein the first user input from the primary user comprises a movement of at least part of the primary user's body captured by the primary virtual reality headset. ### Claim 19 (depends on 17) The system of claim 17, wherein the secondary mobile device comprises a secondary virtual reality headset. ### Claim 20 (depends on 16) The system of claim 16, wherein the video data stream is a recorded video data stream previously captured by the selected video surveillance camera and stored in the cloud network.