Back to results
US 12,762,755 B1Granted
Transformer-based virtual background creation
AssigneeZoom Communications, Inc.
InventorJan Lutter
Life of this patent
Estimating the term…
Abstract
A server converts, using a natural language processing engine, a natural language input into an image generation prompt for a virtual background of a video conference. The server generates, using an image generation engine, the virtual background based on the image generation prompt. The server generates a composite image comprising at least one feature overlaying the virtual background. The server transmits for display, in a visual output associated with the video conference, the composite image.
Claims22
A method, comprising:
- converting, using a natural language processing engine of a server, a natural language input into an image generation prompt for a virtual background of a video conference;
- generating, using an image generation engine of the server, the virtual background based on the image generation prompt;
- generating, by the server, a composite image comprising at least one feature overlaying the virtual background, wherein the at least one feature comprises at least one human body feature recognized from camera generated imagery, and wherein only parts of the virtual background that are not obscured by the at least one human body feature are generated;
- transmitting, by the server, for display in a visual output associated with the video conference, the composite image;
- monitoring, by the server, words spoken during the video conference to identify a change in subject matter being discussed;
- generating, using the image generation engine and based on identifying the change in subject matter, a second virtual background based on at least a subset of the words spoken during the video conference after the change in subject matter;
- and
- transmitting, by the server, for display in the visual output, a second composite image comprising at least one second feature overlaying the second virtual background.
5 more elements
A non-transitory computer readable medium storing instructions operable to cause one or more processors to perform operations comprising:
- converting, using a natural language processing engine of a server, a natural language input into an image generation prompt for a virtual background of a video conference;
- generating, using an image generation engine of the server, the virtual background based on the image generation prompt;
- generating, by the server, a composite image comprising at least one feature overlaying the virtual background, wherein the at least one feature comprises at least one human body feature recognized from camera generated imagery, and wherein only parts of the virtual background that are not obscured by the at least one human body feature are generated;
- transmitting, by the server, for display in a visual output associated with the video conference, the composite image;
- monitoring, by the server, words spoken during the video conference to identify a change in subject matter being discussed;
- generating, using the image generation engine and based on identifying the change in subject matter, a second virtual background based on at least a subset of the words spoken during the video conference after the change in subject matter;
- and
- transmitting, by the server, for display in the visual output, a second composite image comprising at least one second feature overlaying the second virtual background.
5 more elements
A system, comprising:
- a memory subsystem;
- and
- processing circuitry configured to execute instructions stored in the memory subsystem to:
- convert, using a natural language processing engine of a server, a natural language input into an image generation prompt for a virtual background of a video conference;
- generate, using an image generation engine of the server, the virtual background based on the image generation prompt;
- generate, by the server, a composite image comprising at least one feature overlaying the virtual background, wherein the at least one feature comprises at least one human body feature recognized from camera generated imagery, and wherein only parts of the virtual background that are not obscured by the at least one human body feature are generated;
- transmit, by the server, for display in a visual output associated with the video conference, the composite image;
- monitor, by the server, words spoken during the video conference to identify a change in subject matter being discussed;
- generate, using the image generation engine and based on identifying the change in subject matter, a second virtual background based on at least a subset of the words spoken during the video conference after the change in subject matter;
- and
- transmit, by the server, for display in the visual output, a second composite image comprising at least one second feature overlaying the second virtual background.
8 more elements
Dependencies are inferred from the claim text.