Text detection and extraction for shared screen presentations

One or more non-transitory computer-readable storage media storing one or more sequences of instructions which, when executed using one or more processors of a computer system, cause the one or more processors to execute:

• receiving, from a computing device, at least a portion of a screen capture of an application window displayed on the computing device while the computing device accesses or executes a videoconferencing application during a videoconference, the at least a portion of the screen capture of the application window comprising a set of digital images being presented in the videoconference;
• executing an optical character recognition (OCR) process on the at least a portion of the screen capture of the application window to identify one or more natural language text characters included within the set of digital images;
• accessing a knowledge store to identify a set of stored information associated with one or more text characters of the identified one or more natural language text characters, wherein accessing the knowledge store to identify the set of stored information is performed in response to the identifying of the one or more natural language text characters by the OCR process and without any requirement of a user request for information associated with the one or more text characters;
• programmatically transmitting to the computing device, in response to the identifying of the set of stored information associated with the one or more text characters, instructions for displaying one or more components that can overlay the videoconferencing application executing on the computing device, the one or more components being formatted to emphasize the one or more text characters as an indication that an association has been identified between the one or more text characters and the set of information;
• and
• programmatically instructing the computing device to redisplay the application window along with the one or more components overlaying the videoconferencing application, such that the one or more text characters are displayed as emphasized within the set of digital images as the indication that an association has been identified between the one or more text characters and the set of information.

A computer system, comprising:

• one or more processors;
• and
• one or more non-transitory computer-readable storage media storing one or more sequences of instructions which, when executed using the one or more processors, cause the one or more processors to execute:
• receiving, from a computing device, at least a portion of a screen capture of an application window displayed on the computing device while the computing device accesses or executes a videoconferencing application during a videoconference, the at least a portion of the screen capture of the application window comprising a set of digital images being presented in the videoconference;
• executing an optical character recognition (OCR) process on the at least a portion of the screen capture of the application window to identify one or more natural language text characters included within the set of digital images;
• accessing a knowledge store to identify a set of stored information associated with one or more text characters of the identified one or more natural language text characters, wherein accessing the knowledge store to identify the set of stored information is performed in response to the identifying of the one or more natural language text characters by the OCR process and without any requirement of a user request for information associated with the one or more text characters;
• programmatically transmitting to the computing device, in response to the identifying of the set of stored information associated with the one or more text characters, instructions for displaying one or more components that can overlay the videoconferencing application executing on the computing device, the one or more components being formatted to emphasize the one or more text characters as an indication that an association has been identified between the one or more text characters and the set of information;
• and
• programmatically instructing the computing device to redisplay the application window along with the one or more components overlaying the videoconferencing application, such that the one or more text characters are displayed as emphasized within the set of digital images as the indication that an association has been identified between the one or more text characters and the set of information.