# US 2019/0171780 A1 · Orienteering system for responding to an emergency in a structure

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0171780 A1
- Document ID: US20190171780A1
- Status: Published application
- Kind: A1
- Application number: 16/249,574
- Filed: 2019-01-16
- Published: 2019-06-06
- Earliest claimed: 2017-02-22
- Assignees: Middle Chart, LLC
- Applicants: Middle Chart, LLC
- Inventors: Michael S. Santarone; Michael Wodrich; Jason E. Duff
- Web page: https://patentgrep.com/patent/US20190171780A1

## CPC

- G06F 30/13: Architectural design, e.g. computer-aided architectural design [CAAD] related to design of buildings, bridges, landscapes, production plants or roads
- G02B 27/0093: {with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking}
- G02B 27/0172: {characterised by optical features}
- G06Q 10/06: Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- G02B 27/017: {Head mounted}
- G02B 2027/0138: {comprising image capture systems, e.g. camera}
- G02B 2027/014: {comprising information/image processing systems}
- G02B 2027/0178: {Eyeglass type (eyeglass details G02C)}
- G02B 2027/0187: {slaved to motion of at least a part of the body of the user, e.g. head, eye}
- G06T 7/00: Image analysis
- G06T 2210/04: Architectural design, interior design
- Y02P 90/84: Greenhouse gas [GHG] management systems
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- Y02P: CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS

## Abstract

Method and apparatus for responding to an emergency using orienteering methods. An Augmented Virtual Model (AVM) may assist in determining the nature of the emergency and a path to be taken by an emergency responder. By referencing the AVM on a smart device, such as one located in the visor of a firefighter, the emergency responder can quickly and easily locate a cause of the emergency and address it, as well as rescue lives endangered by the emergency.

## Claims

### Claim 1

A method of conducting an emergency response based upon orienteering, the method comprising:
a) associating a structure with an emergency;
b) with an agent located at a first position relative to a ground plane, supporting a smart device at the first position comprising a wireless transceiver, said first position located within a perimeter of the structure;
c) while maintaining the smart device at the first position relative to the ground plane, wirelessly communicating between the smart device and multiple reference point transceivers located in or proximate to the structure;
d) determining first position coordinates of the smart device within the structure based upon the wireless communication between the smart device and the multiple reference point transceivers, the first position coordinates comprising an X, Y and Z value;
e) accessing a digital model of the structure comprising one or more virtual representations of structural elements of the structure;
f) performing an orienteering routine with the smart device comprising determining a direction of interest for the agent based upon generation of a vector commencing at the first position coordinates, said direction of interest based upon first position coordinates and the digital model of the structure; and
g) tracking movement of the agent and the smart device to second position coordinates.

### Claim 2 (depends on 1)

The method of claim 1 additionally comprising the step of generating a first user interface on the smart device, the first user interface comprising directions for movement within the structure based upon the first position coordinates of the smart device and the representations of structural elements of the structure.

### Claim 3 (depends on 2)

The method of claim 2, wherein the structure is identified based upon a geospatial location designation of the structure.

### Claim 4 (depends on 3)

The method of claim 3 wherein the geospatial location designation comprises GPS coordinates.

### Claim 5 (depends on 3)

The method of claim 3 wherein the geospatial location designation comprises a street address.

### Claim 6 (depends on 3)

The method of claim 3 additionally comprises the steps of:
a) receiving a sensor reading from a sensor located within the structure; and
b) generating an instruction to the agent based upon the sensor reading, the position of the agent within the structure and a virtual model of the structure.

### Claim 7 (depends on 6)

The method of claim 6 wherein the sensor located within the structure is affixed to the agent.

### Claim 8 (depends on 6)

The method of claim 6 wherein the sensor located within the structure is affixed to the structure.

### Claim 9 (depends on 7)

The method of claim 7, wherein the agent comprises an emergency responder person.

### Claim 10 (depends on 7)

The method of claim 7, wherein the agent comprises one or both of an unmanned ground vehicle and an unmanned aerial vehicle.

### Claim 11 (depends on 10)

The method of claim 10 wherein the orienteering routine comprises the additional method steps of:
determining a distance of the smart device at a first position relative to the ground plane to at least three wireless reference point transceivers;
determining a distance of one of: the smart device and an auxiliary smart device, at a second position relative to the ground plane to the at least three wireless reference point transceivers; and
generating a vector originating from the first position and extending through the second position.

### Claim 12 (depends on 11)

The method of claim 11 additionally comprising the step of determining a type of emergency based upon sensor readings of sensors located within, or proximate to, the structure.

### Claim 13 (depends on 12)

The method of claim 12 additionally comprising the steps of:
designating in the virtual model the position of the smart device;
designating in the virtual model a location of an emergency condition for which the Agent is responding; and
determining an orienteering instruction to direct the agent to the location of the emergency condition; and
generating an Agent interface comprising the orienteering instruction.

### Claim 14 (depends on 13)

The method of claim 13, additionally comprising the steps of:
identifying an item of emergency response equipment to be utilized by the agent in response to the emergency condition; and
generating a user interface on the smart device comprising operating instructions for the emergency response equipment.

### Claim 15 (depends on 14)

The method of claim 14, additionally comprising the steps of:
identifying a location of the emergency response equipment;
designating the location of the emergency response equipment as a destination for the agent; and
wirelessly transmitting to the smart device supported by the agent an orienteering instruction comprising a suggested path of travel based upon the first position of the agent and a direction of interest determined while the agent remained in the first position.

### Claim 16 (depends on 13)

The method of claim 13 wherein the orienteering instruction comprises a direction of travel of the agent from the first position coordinates, said direction of travel indicated in relation to the direction of interest and forward movement in one of: a left, a right and a straight forward direction.

### Claim 17 (depends on 16)

The method of claim 16 additionally comprising the step of recording a periodic sequence locations of agent while the emergency responder is located within the structure.

### Claim 18 (depends on 17)

The method of claim 17, wherein the virtual model comprises as built data and experiential data, and wherein the method further comprises: updating the experiential data of the virtual model to reflect an occurrence of an emergency within the structure.

### Claim 19 (depends on 1)

The method of claim 1, wherein at least one transceiver comprises a Ultra Wideband transmitter.

### Claim 20 (depends on 3)

The method of claim 3, wherein the smart device further comprises an accelerometer, and a direction of interest is computed based upon data generated by the accelerometer.
