Annotating screen content in a mobile environment

A client device, the client device comprising:

• at least one processor;
• and
• memory storing instructions that, when executed by the at least one processor, cause the at least one processor to:
• identify an area of actionable content on a current screen of a display of the client device, the current screen of the display of the client device being associated with a software application that is accessible at the client device;
• in response to identifying the area of actionable content, generate a selectable visual cue for the area of actionable content, the selectable visual cue for the area of actionable content being associated with multiple candidate actions for the area of actionable content;
• graphically annotate the area of actionable content on the current screen of the display of the client device with the selectable visual cue;
• receive, from a user of the client device, a user selection of the selectable visual cue;
• in response to receiving the user selection of the selectable visual cue:
• cause an indication of the multiple candidate action to be provided for presentation to the user via the display of the client device;
• in response to receiving a further user selection, from the user of the client device, of a first candidate action, of the multiple candidate actions:
• cause a first screen that is associated with the first candidate action to overlay the current screen of the display of the client device without leaving a context of the current application;
• in response to receiving a further user selection, from the user of the client device, of a second candidate action, of the multiple candidate actions:
• cause a second screen that is associated with the second candidate action to overlay the current screen of the display of the client device without leaving a context of the current application,
• wherein the second candidate action differs from the first candidate action, and
• wherein the second screen that is associated with the second candidate action differs from the first screen that is associated with the first candidate action;
• and
• in response to receiving a further user selection, from the user of the client device, of a third candidate action, of the multiple candidate actions:
• cause the client device to launch an additional software application associated with the third candidate action and that is also accessible at the client device,
• wherein the third candidate action differs from both the first candidate action and the second candidate action, and
• wherein the additional software application associated with the third candidate action is in addition to the software application.

A non-transitory computer-readable storage medium storing instructions that, when executed by at least one processor, cause the at least one processor to perform operations, the operations comprising:

• identifying an area of actionable content on a current screen of a display of a client device, the current screen of the display of the client device being associated with a software application that is accessible at the client device;
• in response to identifying the area of actionable content, generating a selectable visual cue for the area of actionable content, the selectable visual cue for the area of actionable content being associated with multiple candidate actions for the area of actionable content;
• graphically annotating the area of actionable content on the current screen of the display of the client device with the selectable visual cue;
• receiving, from a user of the client device, a user selection of the selectable visual cue;
• in response to receiving the user selection of the selectable visual cue:
• causing an indication of the multiple candidate action to be provided for presentation to the user via the display of the client device;
• in response to receiving a further user selection, from the user of the client device, of a first candidate action, of the multiple candidate actions:
• causing a first screen that is associated with the first candidate action to overlay the current screen of the display of the client device without leaving a context of the current application;
• in response to receiving a further user selection, from the user of the client device, of a second candidate action, of the multiple candidate actions:
• causing a second screen that is associated with the second candidate action to overlay the current screen of the display of the client device without leaving a context of the current application,
• wherein the second candidate action differs from the first candidate action, and
• wherein the second screen that is associated with the second candidate action differs from the first screen that is associated with the first candidate action;
• and
• in response to receiving a further user selection, from the user of the client device, of a third candidate action, of the multiple candidate actions:
• causing the client device to launch an additional software application associated with the third candidate action and that is also accessible at the client device,
• wherein the third candidate action differs from both the first candidate action and the second candidate action, and
• wherein the additional software application associated with the third candidate action is in addition to the software application.