Back to results
US 12,223,472 B2Granted
XR-based supervision assisting device, method and program
AssigneesJae Heon Jung, Yu Mi Lee, SLZ Inc.
InventorsJae Heon Jung, Yu Mi Lee
Life of this patent
Estimating the term…
Abstract
The present disclosure relates to an extended reality (XR)-based supervision assisting device, which finds a construction error by comparing a real design object photographed by a camera of the supervision assisting device with building information modelling (BIM) design data, and corrects the BIM design data to fit the real design object when the construction error between the real design object and the BIM design data exceeds a preset error tolerance range, thereby adjusting the BIM design data according to the construction error.
Claims18
An extended reality (XR)-based wearable supervision assisting device for assisting supervision of a construction site, the XR-based wearable supervision assisting device comprising:
- a camera configured to photograph an image, wherein the camera comprises a gaze tracking camera configured to track a supervisor's gaze based on eye movements of the supervisor;
- a transparent display unit;
- a communication unit acquiring 3D-based building information modelling (BIM) design data for at least one real design object actually installed in the construction site;
- and
- a processor performing operations of:
- grasping the supervisor's gaze through the gaze tracking camera;
- determining a real design object, which the supervisor is watching during a predetermined period of time or more, as a recognition target;
- acquiring the BIM design data for the determined real design object through the communication unit;
- rendering a virtual XR design object for the determined real design object on the basis of the acquired BIM design data;
- displaying the rendered XR design object at a position corresponding to the determined real design object on the transparent display unit;
- comparing the BIM design data of the XR design object with the photograph image, and checking an error between the XR design object and the determined real design object;
- and
- informing the supervisor of that the checked error deviates from a predetermined allowable error range,
- wherein the processor analyzes the BIM design data and derives a supervision progress direction from a starting position of the supervision,
- wherein the processor determines a completion of correction of the error in the photographed image when correction of the error of the determined real design object that the supervisor is watching through the transparent display unit has been completed, and
- wherein when the completion of correction of the error is determined, the processor renders and displays an XR content guiding a next supervision position on the basis of the supervision progress direction and a current position of the supervision assisting device.
13 more elements
An extended reality (XR)-based wearable supervision assisting device for assisting supervision of a construction site, the XR-based wearable supervision assisting device comprising:
- a camera configured to photograph an image, wherein the camera comprises a gaze tracking camera configured to track a supervisor's gaze based on eye movements of the supervisor;
- a display unit;
- a communication unit acquiring 3D-based building information modelling (BIM) design data for at least one real design object actually installed in the construction site;
- and
- a processor performing operations of:
- grasping the supervisor's gaze through the gaze tracking camera;
- determining a real design object, which the supervisor is watching during a predetermined period of time or more, as a recognition target;
- acquiring the BIM design data for the determined real design object in the photographed image;
- rendering a virtual XR design object for the determined real design object on the basis of the acquired BIM design data;
- displaying the rendered XR design object at a position corresponding to the determined real design object on the display unit;
- comparing the BIM design data of the XR design object with the photograph image, and checking an error between the XR design object and the determined real design object;
- and
- informing the supervisor of that the checked error deviates from a predetermined allowable error range,
- wherein the processor analyzes the BIM design data and derives a supervision progress direction from a starting position of the supervision,
- wherein the processor determines a completion of correction of the error in the photographed image when correction of the error of the determined real design object that the supervisor is watching through the display unit has been completed, and
- wherein when the completion of correction of the error is determined, the processor renders and displays an XR content guiding a next supervision position on the basis of the supervision progress direction and a current position of the supervision assisting device.
13 more elements
An extended reality (XR)-based supervision assisting method carried out by an extended reality (XR)-based wearable supervision assisting device for assisting supervision of a construction site, the XR-based wearable supervision assisting method comprising:
- grasping a supervisor's gaze through a gaze tracking camera of the XR-based wearable supervision assisting device, based on eye movements of the supervisor;
- determining a real design object, which the supervisor is watching through a transparent display unit of the XR-based wearable supervision assisting device during a predetermined period of time or more, as a recognition target;
- acquiring building information modelling (BIM) design data for the determined real design object;
- rendering a virtual XR design object for the determined real design object on the basis of the acquired BIM design data;
- displaying the rendered XR design object at a position corresponding to the determined real design object on the transparent display unit;
- comparing the BIM design data of the XR design object with an image photographed by a camera of the XR-based wearable supervision assisting device, and checking an error between the XR design object and the determined real design object;
- informing the supervisor of that the checked error deviates from a predetermined allowable error range;
- analyzing the BIM design data and derives a supervision progress direction from a starting position of the supervision;
- determining a completion of correction of the error in the photographed image when correction of the error of the determined real design object that the supervisor is watching through the transparent display unit has been completed;
- and
- when the completion of correction of the error is determined, rendering and displaying an XR content guiding a next supervision position on the basis of the supervision progress direction and a current position of the supervision assisting device.
8 more elements
Dependencies are inferred from the claim text.