Augmented reality interface for assisting a user to operate an ultrasound device

A system, comprising:

• a mobile device comprising a display and at least one processor configured to:
• capture, using a camera coupled to the mobile device, an image of an ultrasound device being used by an operator when the ultrasound device is in the camera's field of view;
• identify a pose of the ultrasound device in the image of the ultrasound device;
• generate, using the at least one processor of the mobile device, a composite image at least in part by overlaying, onto the image of the ultrasound device and using the pose of the ultrasound device, an indication of a direction in which the operator is to move the ultrasound device, wherein overlaying the indication onto the image of the ultrasound device comprises overlaying an arrow onto at least part of the ultrasound device in the image of the ultrasound device, the arrow indicating the direction in which the operator is to move the ultrasound device;
• and
• cause the display to present the composite image to the operator,
• wherein the at least one processor of the mobile device is further configured to:
• prior to generating the composite image:
• analyze an ultrasound image captured by the ultrasound device by using a multi-layer neural network, and
• determine the indication using an output of the multi-layer neural network.

At least one non-transitory computer-readable storage medium storing processor-executable instructions that, when executed by at least one processor of a mobile device, cause the at least one processor to:

• capture, using a camera coupled to the mobile device, an image of an ultrasound device being used by an operator when the ultrasound device is in the camera's field of view;
• identify a pose of the ultrasound device in the image of the ultrasound device;
• generate, using the at least one processor of the mobile device, a composite image at least in part by overlaying, onto the image of the ultrasound device and using the pose of the ultrasound device, an indication of a direction in which the operator is to move the ultrasound device, wherein overlaying the indication onto the image of the ultrasound device comprises overlaying an arrow onto at least part of the ultrasound device in the image of the ultrasound device, the arrow indicating the direction in which the operator is to move the ultrasound device;
• and
• cause the display to present the composite image to the operator,
• wherein the processor-executable instructions further cause the at least one processor of the mobile device to:
• prior to generating the composite image:
• analyze an ultrasound image captured by the ultrasound device by using a multi-layer neural network, and
• determine the indication using an output of the multi-layer neural network.