# US 2019/0171667 A1 · Screen capture data amalgamation

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0171667 A1
- Document ID: US20190171667A1
- Status: Published application
- Kind: A1
- Application number: 16/270,921
- Filed: 2019-02-08
- Published: 2019-06-06
- Earliest claimed: 2016-11-02
- Assignees: International Business Machines Corporation
- Applicants: International Business Machines Corporation
- Inventors: Venkata V. Gadepalli; Trudy L. Hewitt; Ashok K. Iyengar; James M. Moreno
- Web page: https://patentgrep.com/patent/US20190171667A1

## CPC

- H04L 51/10: Multimedia information
- G06F 16/5866: {using information manually generated, e.g. tags, keywords, comments, manually generated location and time information}
- G06F 40/169: Annotation, e.g. comment data or footnotes
- G06F 40/279: Recognition of textual entities
- G06F 40/35: Discourse or dialogue representation
- H04L 51/216: Handling conversation history, e.g. grouping of messages in sessions or threads
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

At a device of a sender, a screen capture image is captured from a first portion of data presented on the device by a data source. Historical messaging data is analyzed to compute a set of topics in which the sender has participated. Using a topic from the set of topics as a context, a second portion of the data presented on the device by the data source is searched to extract an additional information from the second portion, the additional information corresponding to the context. the additional information is associated with the screen capture image. The screen capture image and the additional information are caused to be transmitted in a messaging channel.

## Claims

### Claim 1

A method comprising:
capturing, at a device of a sender, from a first portion of data presented on the device by a data source, a screen capture image, the data being presented during communication on a messaging channel, the messaging channel comprising a system for electronic communication;
extracting a context by analyzing historical topics of communications of the sender from a set of messaging channels;
extracting additional information related to the context from a second portion of the data presented on the device, the second portion comprising data not captured in the screen capture image;
associating the additional information with the screen capture image; and
causing the screen capture image and the additional information to be transmitted in the messaging channel.

### Claim 2 (depends on 1)

The method of claim 1, further comprising:
detecting, responsive to the causing, a subsequent communication in the messaging channel;
analyzing data of the subsequent communication to extract a second context;
searching, using the second context, the second portion to locate a second additional data, the second additional data corresponding to the second context;
associating the second additional information with the screen capture image; and
causing the second additional information to be transmitted relative to the screen capture image in the messaging channel.

### Claim 3 (depends on 1)

The method of claim 1, further comprising:
detecting, responsive to the causing, a subsequent communication in the messaging channel;
analyzing data of the subsequent communication to extract a second context;
searching, using the second context, the second portion to locate a second additional data, the second additional data corresponding to the second context;
failing to locate the second additional information in the second portion; and
causing a message about the failing to be transmitted relative to the screen capture image in the messaging channel.

### Claim 4 (depends on 1)

The method of claim 1, further comprising:
adding, as a part of the associating, the additional information as metadata of the screen capture image.

### Claim 5 (depends on 1)

The method of claim 1, further comprising:
modifying, as a part of the associating, the screen capture image to embed the additional information into the screen capture image.

### Claim 6 (depends on 1)

The method of claim 1, further comprising:
determining from analyzing the historical messaging data, a likely receiver of the screen capture image; and
selecting a topic, responsive to the sender communicating with the likely receiver about the topic, from the historical topics in historical messaging data, the topic forming the context.

### Claim 7 (depends on 1)

The method of claim 1, further comprising:
identifying a specified receiver of the screen capture image; and
selecting a topic, responsive to the sender communicating with the specified receiver about the topic, from the historical topics in historical messaging data, the topic forming the context.

### Claim 8 (depends on 1)

The method of claim 1, wherein the first portion of the data is visibly presented on a display screen associated with the device, and wherein the second portion is available at the device.

### Claim 9 (depends on 8)

The method of claim 8, wherein the second portion is not visible on the device.

### Claim 10 (depends on 1)

The method of claim 1, further comprising:
computing a past period, wherein the historical topics are present in historical messaging data of the past period.

### Claim 11

A computer usable program product comprising a computer readable storage medium, and program instructions stored on the computer readable storage medium, the stored program instructions comprising:
program instructions to capture, at a device of a sender, from a first portion of data presented on the device by a data source, a screen capture image, the data being presented during communication on a messaging channel, the messaging channel comprising a system for electronic communication;
program instructions to extract a context by analyzing historical topics of communications of the sender from a set of messaging channels;
program instructions to extract additional information related to the context from a second portion of the data presented on the device, the second portion comprising data not captured in the screen capture image;
program instructions to associate the additional information with the screen capture image; and
causing the screen capture image and the additional information to be transmitted in the messaging channel.

### Claim 12 (depends on 11)

The computer usable program product of claim 11, further comprising:
program instructions to detect, responsive to the causing, a subsequent communication in the messaging channel;
program instructions to analyze data of the subsequent communication to extract a second context;
program instructions to search, using the second context, the second portion to locate a second additional data, the second additional data corresponding to the second context;
program instructions to associate the second additional information with the screen capture image; and
program instructions to cause the second additional information to be transmitted relative to the screen capture image in the messaging channel.

### Claim 13 (depends on 11)

The computer usable program product of claim 11, further comprising:
program instructions to detect, responsive to the causing, a subsequent communication in the messaging channel;
program instructions to analyze data of the subsequent communication to extract a second context;
program instructions to search, using the second context, the second portion to locate a second additional data, the second additional data corresponding to the second context;
program instructions to fail to locate the second additional information in the second portion; and
program instructions to cause a message about the failing to be transmitted relative to the screen capture image in the messaging channel.

### Claim 14 (depends on 11)

The computer usable program product of claim 11, further comprising:
program instructions to add, as a part of the associating, the additional information as metadata of the screen capture image.

### Claim 15 (depends on 11)

The computer usable program product of claim 11, further comprising:
program instructions to modify, as a part of the associating, the screen capture image to embed the additional information into the screen capture image.

### Claim 16 (depends on 11)

The computer usable program product of claim 11, further comprising:
program instructions to determine from analyzing the historical messaging data, a likely receiver of the screen capture image; and
program instructions to select a topic, responsive to the sender communicating with the likely receiver about the topic, from the historical topics in the historical messaging data, the topic forming the context.

### Claim 17 (depends on 11)

The computer usable program product of claim 11, further comprising:
program instructions to identify a specified receiver of the screen capture image; and
program instructions to select a topic, responsive to the sender communicating with the specified receiver about the topic, from the historical topics in the historical messaging data, the topic forming the context.

### Claim 18 (depends on 11)

The computer usable program product of claim 11, wherein the computer usable code is stored in a computer readable storage device in a data processing system, and wherein the computer usable code is transferred over a network from a remote data processing system.

### Claim 19 (depends on 11)

The computer usable program product of claim 11, wherein the computer usable code is stored in a computer readable storage device in a server data processing system, and wherein the computer usable code is downloaded over a network to a remote data processing system for use in a computer readable storage device associated with the remote data processing system.

### Claim 20

A computer system comprising a processor, a computer-readable memory, and a computer readable storage medium, and program instructions stored on the computer readable storage medium for execution by the processor via the memory, the stored program instructions comprising:
program instructions to capture, at a device of a sender, from a first portion of data presented on the device by a data source, a screen capture image, the data being presented during communication on a messaging channel, the messaging channel comprising a system for electronic communication;
program instructions to extract a context by analyzing historical topics of communications of the sender from a set of messaging channels;
program instructions to extract additional information related to the context from a second portion of the data presented on the device, the second portion comprising data not captured in the screen capture image;
program instructions to associate the additional information with the screen capture image; and
causing the screen capture image and the additional information to be transmitted in the messaging channel.
