# US 2022/0036613 A1 · Display responsive communication system and method > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2022/0036613 A1 - Document ID: US20220036613A1 - Status: Published application - Kind: A1 - Application number: 17/009,194 - Filed: 2020-09-01 - Published: 2022-02-03 - Earliest claimed: 2020-08-03 - Assignees: Google Inc. - Applicants: Google LLC - Inventors: Mikaël Bonnevie; Yuanzhen Li; Ce Liu - Web page: https://patentgrep.com/patent/US20220036613A1 ## CPC - G06T 11/60: Creating or editing images; Combining images with text - G06T 3/40: Scaling of whole images or parts thereof, e.g. expanding or contracting - G06T 5/70: Denoising; Smoothing - G06T 7/194: involving foreground-background segmentation - G06T 2200/24: involving graphical user interfaces [GUIs] - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL ## Abstract A multimedia communication system and computer-implemented method for transmitting auxiliary display content to an end-user communication device to be rendered on a display device with a special effect to emphasize an image included in the auxiliary display content, comprising a processor and a transmitter. The processor can be arranged to analyze image data included in an auxiliary display content, detect an object image or a background image in the auxiliary display content based on the analysis of the image data, determine a special effect based on the analysis of the image data, and apply the special effect to the auxiliary display content to modify display properties for the auxiliary display content such that the object image is emphasized or pops-out. The transmitter can be arranged to send the auxiliary display content with modified display properties to an end-user communication device. The special effect can comprise a non-customization special effect, a simple foreground special effect or a selective foreground special effect. ## Claims ### Claim 1 A multimedia communication system for transmitting auxiliary display content to an end-user communication device to be rendered on a display device with a special effect to emphasize an image included in the auxiliary display content, the multimedia communication system comprising: a processor that is arranged to: analyze image data included in an auxiliary display content; detect at least a foreground image and a background image in the auxiliary display content based on the analysis of the image data; determine a special effect to emphasize the foreground image based on the analysis of the image data, wherein the special effect comprises a predetermined shape with a plurality of portions overlapping with the foreground image; and apply the special effect to the auxiliary display content to modify display properties for the auxiliary display content by adding the predetermined shape such that at least one of the plurality of portions overlapping with the foreground image is a non-overlay portion and at least another one of the plurality of portions overlapping with the foreground image is an overlay portion, wherein the foreground image extends from at least an outer side of the overlay portion; and, a transmitter arranged to send the auxiliary display content with modified display properties to an end-user communication device. ### Claim 2 (depends on 1) The multimedia communication system of claim 1, wherein the processor is arranged to: generate or modify a multimedia content rendering application; and send the multimedia content rendering application to the end-user communication device, wherein the multimedia content rendering application is arranged to, when executed by a processor in the end-user communication device, render the auxiliary display content with modified display properties on a display device. ### Claim 3 (depends on 1) The multimedia communication system of claim 1, wherein the special effect comprises a non-customization special effect that comprises an overlay border that, when rendered by the end-user communication device, is displayed around an inner-border of an auxiliary display content display window on a display device. ### Claim 4 (depends on 3) The multimedia communication system of claim 3, wherein the overlay border has at least one corner and the non-overlay portion that emphasize an object image in the auxiliary display content. ### Claim 5 (depends on 1) The multimedia communication system of claim 1, wherein the special effect comprises a simple foreground special effect that comprises an overlay border having an overlay portion and the non-overlay portion that, when rendered by the end-user communication device, is displayed as an overlay border atop of the background image in an auxiliary display content display window, with an object image being displayed without any overlay in the auxiliary display content display window. ### Claim 6 (depends on 5) The multimedia communication system of claim 5, wherein the overlay border has at least one corner and the non-overlay portion is rendered to emphasize the object image or an action depicted in the auxiliary display content. ### Claim 7 (depends on 1) The multimedia communication system of claim 1, wherein the special effect comprises a selective foreground special effect that comprises an overlay border having an overlay portion and the non-overlay portion that, when rendered by the end-user communication device, is displayed as an overlay border atop of the background image in an auxiliary display content display window, with at least a portion of an object image being displayed without any overlay in the auxiliary display content display window. ### Claim 8 (depends on 1) The multimedia communication system of claim 1, wherein the special effect comprises a selective foreground special effect that comprises a zoom-in or a zoom-out of an object image, or a blurring of the background image when rendered by the end-user communication device. ### Claim 9 (canceled) ### Claim 10 (depends on 9) The multimedia communication system of claim 9, wherein the selective foreground special effect further comprises zooming-in or zooming-out an object image when rendered by the end-user communication device. ### Claim 11 A computer-implemented method for transmitting auxiliary display content to an end-user communication device to be rendered on a display device with a special effect to emphasize an image included in the auxiliary display content, the method comprising: analyzing, by a processor, image data included in an auxiliary display content; detecting, by the processor, at least a foreground image and a background image in the auxiliary display content; determining, by the processor, a special effect to emphasize the foreground image based on the analysis of the image data, wherein the special effect comprises a predetermined shape with a plurality of portions overlapping with the foreground image; and applying, by the processor, the special effect to the auxiliary display content to modify display properties for the auxiliary display content by adding the predetermined shape such that at least one of the plurality of portions overlapping with the foreground image is a non-overlay portion and at least another one of the plurality of portions overlapping with the foreground image is an overlay portion, wherein the foreground image extends from at least an outer side of the overlay portion. ### Claim 12 (depends on 11) The method of claim 11, further comprising: creating a multimedia content rendering application; and sending the multimedia content rendering application to an end-user communication device, wherein the multimedia content rendering application is arranged to, when executed by a processor in the end-user communication device, render the auxiliary display content with modified display properties on a display device. ### Claim 13 (depends on 11) The method of claim 11, wherein the special effect comprises a non-customization special effect that comprises an overlay border that, when rendered by an end-user communication device, is displayed around an inner-border of an auxiliary display content display window on a display device. ### Claim 14 (depends on 13) The method of claim 13, wherein the overlay border has at least one corner and the non-overlay portion that emphasize an object image in the auxiliary display content. ### Claim 15 (depends on 11) The method of claim 11, wherein the special effect comprises a simple foreground special effect that comprises an overlay border having an overlay portion and the non-overlay portion that, when rendered by an end-user communication device, is displayed as an overlay border atop of the background image in an auxiliary display content display window, with an object image being displayed without any overlay in the auxiliary display content display window. ### Claim 16 (depends on 15) The method of claim 15, wherein the overlay border has at least one corner and the non-overlay portion is rendered to emphasize the object image or an action depicted in the auxiliary display content. ### Claim 17 (depends on 11) The method of claim 11, wherein the special effect comprises a selective foreground special effect that comprises an overlay border having an overlay portion and the non-overlay portion that, when rendered by an end-user communication device, is displayed as an overlay border atop of the background image in an auxiliary display content display window, with at least a portion of an object image being displayed without any overlay in the auxiliary display content display window. ### Claim 18 (depends on 11) The method of claim 11, wherein the special effect comprises a selective foreground special effect that comprises a zoom-in or a zoom-out of an object image when rendered by an end-user communication device, or a blurring of the background image when rendered by the end-user communication device. ### Claim 19 (canceled) ### Claim 20 (depends on 19) The method of claim 19, wherein the selective foreground special effect further comprises zooming-in or zooming-out an object image when rendered by the end-user communication device.