System and method for image detection during instrument grasping and stapling

A method comprising:

• operating, by one or more processors, an end effector having a first jaw and a second jaw;
• determining, by the one or more processors, an orientation of a view of an imaging sensor relative to a workspace, the imaging sensor being mounted to the end effector;
• generating, by the one or more processors, orientation hints based on the orientation of the view;
• and
• displaying, by the one or more processors, the one or more orientation hints proximate to a first image of the end effector, on a user interface to provide an indication of the orientation of the end effector within a workspace.

A non-transitory machine-readable medium comprising a plurality of machine-readable instructions which when executed by one or more processors are adapted to cause the one or more processors to perform a method comprising:

• operating, by one or more processors, an end effector having a first jaw and a second jaw;
• determining, by the one or more processors, an orientation of a view of an imaging sensor relative to a workspace, the imaging sensor being mounted to the end effector;
• generating, by the one or more processors, orientation hints based on the orientation of the view;
• and
• displaying, by the one or more processors, the one or more orientation hints proximate to a first image of the end effector, on a user interface to provide an indication of the orientation of the end effector within a workspace.