Advanced head display unit for fire fighters
AssigneeRed Pacs, LLC
InventorRobert Edwin Douglas
Life of this patent
Estimating the term…
Abstract
In this patent, an advanced head display unit designed primarily for fire fighters is disclosed. The advanced augmented reality/virtual reality (AR/VR) head display unit improves coordination between teammates through eye tracking coupled with augmented reality features. This allows one fire fighter to know where another fire fighter is looking and helps coordinate tasks by dividing the scene into sectors and visibly marking each sector. Further, this system helps determine where to hose with a smart target system. Further, multiple sensors are utilized together to triangulate the location of a victim's voice. Additional advantages are also disclosed above.
Claims20
A method comprising:
- performing scene understanding of an image of a physical scene obtained from a sensor system on a head display unit
- wherein the physical scene contains physical items,
- wherein said image contains structures,
- wherein said structures correspond to said physical items,
- wherein said scene understanding comprises segmentation of said image into segmented structure(s);
- displaying said image on said head display unit;
- performing eye tracking of a first user's eye movements while said first user is wearing the head display unit
- wherein the head display unit has eye tracking capabilities, and
- wherein the first user visualizes at least one of said segmented structures which corresponds to at least one of the physical items;
- and
- analyzing eye tracking data of the first user to determine which segmented structure(s) said first user has viewed.
A system comprising:
- a head display unit (HDD) with a left eye display and a right eye display;
- an eye tracking system configured to track a left eye of a user and a right eye of said user,
- a sensor system mounted on said HDU comprising at least one of:
- a camera system;
- a forward looking infrared (FLIR) sensor;
- a laser range finder;
- a digital compass;
- a GPS;
- and
- acoustic sensor(s);
- a processor wherein the processor performs processing comprising:
- performing scene understanding of an image of a physical scene obtained from said sensor system
- wherein the physical scene contains physical items,
- wherein said image contains structures,
- wherein said structures correspond to said physical items,
- wherein said scene understanding comprises segmentation of said image into segmented structure(s);
- performing eye tracking of said user s eye movements while said user is wearing the head display unit
- wherein the head display unit has eye tracking capabilities, and
- wherein said user visualizes at least one of the physical items;
- and
- analyzing eye tracking data of said user to determine which segmented structure(s) said user has viewed.
Dependencies are inferred from the claim text.