# US 12,182,980 B2 · Cognitive filtering of content from shared screen display > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,182,980 B2 - Document ID: US12182980B2 - Status: Granted - Kind: B2 - Application number: 17/187,934 - Filed: 2021-03-01 - Published: 2022-09-01 - Granted: 2024-12-31 - Earliest claimed: 2021-03-01 - Assignees: Kyndryl, Inc. - Applicants: Kyndryl, Inc. - Inventors: Thangadurai Muthusamy; Chourasia Abhishek Kumar; Saravanan Devendran; Pietro Iannucci - Web page: https://patentgrep.com/patent/US12182980B2 ## CPC - G06T 7/0002: {Inspection of images, e.g. flaw detection} - G06F 3/1454: {involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay} - G06F 18/2178: {based on feedback of a supervisor} - G06F 18/24: Classification techniques - G06F 18/40: Software arrangements specially adapted for pattern recognition, e.g. user interfaces or toolboxes therefor - G06N 5/04: Inference or reasoning models - G06N 20/00: Machine learning - G06T 5/20: using local operators - G06T 5/60: using machine learning, e.g. neural networks - G06T 5/70: Denoising; Smoothing - G06T 5/77: Retouching; Inpainting; Scratch removal - G06V 30/41: Analysis of document content (recognition of printed characters based on code marks G06V30/224) - G06V 30/413: Classification of content, e.g. text, photographs or tables - G06T 2207/10016: Video; Image sequence - G06T 2207/20081: Training; Learning - G06V 30/10: Character recognition - G09G 2358/00: Arrangements for display data security - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING - G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00) ## Abstract Methods, computer program products, and/or systems are provided that perform the following operations: obtaining source display content; identifying one or more objectionable portions included in the source display content; modifying the one or more objectionable portions included in the source display content to filter content in the one or more objectionable portions; generating a filtered display content, wherein the filtered display content includes the one or more modified objectionable portions and one or more non-objectionable portions of the source display content; and providing the filtered display content for rendering of a shared presentation. ## Claims ### Claim 1 A computer-implemented method comprising: obtaining source display content, the source display content including shared screen content rendered by and being displayed on a screen of a source device and being output by the source device for concurrent display thereof by a remote device located remotely from the source device; identifying one or more objectionable portions included in the source display content; modifying the one or more objectionable portions included in the source display content to filter content in the one or more objectionable portions; generating a filtered display content, wherein the filtered display content includes the one or more modified objectionable portions and one or more non-objectionable portions of the source display content; and providing the filtered display content for rendering of filtered shared screen content by the remote device while the shared screen content is being displayed on the screen of the source device in original form. ### Claim 2 (depends on 1) The computer-implemented method of claim 1, wherein identifying the one or more objectionable portions included in the source display content comprises: obtaining text data and image data in the source display content; and classifying some portions of the source display content as potential objectionable content and classifying other portions of the source display content as potential non-objectionable content based, at least in part, on the text data and image data. ### Claim 3 (depends on 2) The computer-implemented method of claim 2, further comprising: providing the text data and the image data to an image classifier model, wherein the image classifier model is trained to classify the source display content as objectionable content, as non-objectional content, or some of the content as objectionable content and some of the content as non-objectionable content; identifying portions of the source display content as objectionable; and providing the identified portions of the source display content to an image reconstruction model, wherein the image reconstruction model is trained to filter the one or more objectionable portions to obscure content and generate the filtered display content. ### Claim 4 (depends on 3) The computer-implemented method of claim 3, further comprising: providing one or more of the objectionable portions to the image reconstruction model; filtering the one or more objectionable portions to generate one or more modified objectionable portions including obscured content; providing the one or more non-objectionable portions to the image reconstruction model; and generating the filtered display content based on the one or more non-objectionable portions and the one or more modified objectionable portions. ### Claim 5 (depends on 4) The computer-implemented method of claim 4, further comprising: providing preview filtered display content based on the filtered display content; obtaining indications that one or more portions of the preview filtered display content were misclassified; and providing data associated with the one or more misclassified portions for use in updating the image classifier model. ### Claim 6 (depends on 1) The computer-implemented method of claim 1, wherein modifying the one or more objectionable portions included in the source display content comprises: masking the one or more objectionable portions to generate the one or more modified objectionable portions, wherein the masking obscures content in the one or more objectionable portions. ### Claim 7 (depends on 1) The computer-implemented method of claim 1, further comprising: obtaining feedback data associated with the filtered display content, the feedback data including one or more indications of objectionable content misclassified as non-objectionable; and updating an image classifier model and an image reconstruction model based, at least in part, on the feedback data. ### Claim 8 (depends on 7) The computer-implemented method of claim 7, wherein the feedback data includes user preference data. ### Claim 9 (depends on 7) The computer-implemented method of claim 7, wherein the feedback data includes historical shared screen content interaction data associated with the filtered display content. ### Claim 10 (depends on 1) The computer-implemented method of claim 1, wherein the shared screen content rendered by and displayed on the screen of the source device includes a presentation controlled by a user at the source device during a video conference. ### Claim 11 A computer program product comprising a computer readable storage medium having stored thereon: program instructions programmed to obtain source display content, the source display content including shared screen content being displayed on a screen of a source device and being output for concurrent display thereof by a remote device located remotely from the source device; program instructions programmed to identify one or more objectionable portions included in the source display content; program instructions programmed to modify the one or more objectionable portions included in the source display content to filter content in the one or more objectionable portions; program instructions programmed to generate a filtered display content, wherein the filtered display content includes the one or more modified objectionable portions and one or more non-objectionable portions of the source display content; program instructions programmed to provide the filtered display content for rendering of filtered shared screen display content by the remote device while the shared screen content is being displayed on the screen of the source device in original form; program instructions programmed to obtain feedback data associated with the filtered display content, the feedback data including one or more indications of non-objectionable content misclassified as objectionable; and program instructions programmed to update an image classifier model and an image reconstruction model based, at least in part, on the feedback data. ### Claim 12 (depends on 11) The computer program product of claim 11, wherein identifying the one or more objectionable portions included in the source display content comprises: obtaining text data and image data in the source display content; and classifying some portions of the source display content as potential objectionable content and classifying other portions of the source display content as potential non-objectionable content based, at least in part, on the text data and image data. ### Claim 13 (depends on 12) The computer program product of claim 12, the computer readable storage medium having further stored thereon: program instructions programmed to provide the text data and the image data to the image classifier model, wherein the image classifier model is trained to classify the source display content as objectionable content, as non-objectional content, or some of the content as objectionable content and some of the content as non-objectionable content; program instructions programmed to identify portions of the source display content as objectionable; and program instructions programmed to provide the identified portions of the source display content to the image reconstruction model, wherein the image reconstruction model is trained to filter the one or more objectionable portions to obscure content and generate the filtered display content. ### Claim 14 (depends on 13) The computer program product of claim 13, the computer readable storage medium having further stored thereon: program instructions programmed to provide one or more of the objectionable portions to the image reconstruction model; program instructions programmed to filter the one or more objectionable portions to generate one or more modified objectionable portions including obscured content; program instructions programmed to provide the one or more non-objectionable portions to the image reconstruction model; and program instructions programmed to generate the filtered display content based on the one or more non-objectionable portions and the one or more modified objectionable portions. ### Claim 15 (depends on 11) The computer program product of claim 11, wherein modifying the one or more objectionable portions included in the source display content comprises: masking the one or more objectionable portions to generate the one or more modified objectionable portions, wherein the masking obscures content in the one or more objectionable portions. ### Claim 16 (depends on 10) The computer program product of claim 10, the computer readable storage medium having further stored thereon: program instructions programmed to provide preview filtered display content based on the filtered display content; program instructions programmed to obtain indications that one or more portions of the preview filtered display content were misclassified; and program instructions programmed to provide data associated with the one or more misclassified portions for use in updating the image classifier model. ### Claim 17 A computer system comprising: a processor set; and a computer readable storage medium; wherein: the processor set is structured, located, connected and programmed to run program instructions stored on the computer readable storage medium; and the stored program instructions include: program instructions programmed to obtain source display content, the source display content including shared screen content being displayed on a screen of a source device and being output for concurrent display thereof by a remote device located remotely from the source device; program instructions programmed to identify one or more objectionable portions included in the source display content; program instructions programmed to modify the one or more objectionable portions included in the source display content to filter content in the one or more objectionable portions; program instructions programmed to generate a filtered display content, wherein the filtered display content includes the one or more modified objectionable portions and one or more non-objectionable portions of the source display content; program instructions programmed to provide the filtered display content for rendering of filtered shared screen content by the remote device while the shared screen content is being displayed on the screen of the source device; program instructions to obtain feedback data associated with the filtered display content, the feedback data including one or more indications of non-objectionable content misclassified as objectionable; and program instructions to update an image classifier model and an image reconstruction model based, at least in part, on the feedback data. ### Claim 18 (depends on 17) The computer system of claim 17, wherein identifying the one or more objectionable portions included in the source display content comprises: obtaining text data and image data in the source display content; and classifying some portions of the source display content as potential objectionable content and classifying other portions of the source display content as potential non-objectionable content based, at least in part, on the text data and image data. ### Claim 19 (depends on 17) The computer system of claim 17, wherein modifying the one or more objectionable portions included in the source display content comprises: masking the one or more objectionable portions to generate the one or more modified objectionable portions, wherein the masking obscures content in the one or more objectionable portions. ### Claim 20 (depends on 18) The computer system of claim 18, wherein the stored program instructions further include: program instructions programmed to provide the text data and the image data to the image classifier model, wherein the image classifier model is trained to classify content as objectionable content, as non-objectional content, or some of the content as objectionable content and some of the content as non-objectionable content; program instructions programmed to identify portions of the source display content as objectionable; and program instructions programmed to provide the identified portions of the source display content to the image reconstruction model, wherein the image reconstruction model is trained to filter the one or more objectionable portions to obscure content and generate the filtered display content.