Workplace monitoring and semantic entity identification for safe machine operation

A method of monitoring a workspace, the method comprising:

• providing sensors configured to capture images of a workspace;
• storing (i) captured images from the sensors and (ii) a model of machinery located within the workspace, wherein the model comprises movement capabilities of the machinery;
• generating a spatial representation of the workspace based on the captured images;
• identifying first and second non-machinery entities within the workspace;
• generating a first object that specifies attributes of the first non-machinery entity comprising (i) a spatial extent of the first non-machinery entity and (ii) a protective separation distance for the first non-machinery entity;
• generating a second object that specifies attributes of the second non-machinery entity comprising (i) a spatial extent of the second non-machinery entity and (ii) a protective separation distance for the second non-machinery entity;
• recognizing an interaction between the first and second non-machinery entities in the workspace;
• responsive to recognizing the interaction, merging the first and second objects into a merged object that specifies a protective separation distance for the merged object;
• and
• controlling operation of the machinery in accordance with (i) a safety protocol and (ii) the protective separation distance for the merged object.

A system for monitoring a workspace, the system comprising:

• sensors configured to capture images of a workspace;
• memory configured to store (i) captured images from the sensors and (ii) a model of machinery located within the workspace, wherein the model comprises movement capabilities of the machinery;
• and
• a processor configured to:
• generate a spatial representation of the workspace based on the captured images;
• identify first and second non-machinery entities within the workspace;
• generate a first object that specifies attributes of the first non-machinery entity comprising (i) a spatial extent of the first non-machinery entity and (ii) a protective separation distance for the first non-machinery entity;
• generate a second object that specifies attributes of the second non-machinery entity comprising (i) a spatial extent of the second non-machinery entity and (ii) a protective separation distance for the second non-machinery entity;
• monitor a distance between the first and second non-machinery entities;
• and
• control operation of the machinery in accordance with (i) the monitored distance,
• (ii) the attributes of the first non-machinery entity, and (iii) the attributes of the second non-machinery entity.