# US 12,118,681 B2 · Apparatus, system, and method of providing a three dimensional virtual local presence > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,118,681 B2 - Document ID: US12118681B2 - Status: Granted - Kind: B2 - Application number: 18/104,097 - Filed: 2023-01-31 - Published: 2023-09-07 - Granted: 2024-10-15 - Earliest claimed: 2019-07-09 - Applicants: Josh Lehman - Inventors: Josh Lehman - Web page: https://patentgrep.com/patent/US12118681B2 ## CPC - G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)} - G06T 7/20: Analysis of motion (motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51) - G06T 19/20: Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts - G06T 2207/30224: Ball; Puck - G06T 2219/2004: Aligning objects, relative positioning of parts - H04N 9/75: Chroma key - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract A virtual local presence display apparatus, system and method is disclosed. Included are an extraction engine capable of automatically disassociating the virtual local presence from its production background; a first data feed of an actual background in which the displaying device resides; a background data feed of a plurality of optional backgrounds including at least the production background of the virtual local presence; a stream subject data feed of an extracted one of the virtual local presence extracted from the production background; an integrated data feed in which the virtual local presence and a background are integrated; a first processing having a receiver capable of receiving the data feeds and assessing a plurality of focal lengths to focal planes for the virtual presence in the production background, and in a selected one of the other backgrounds; and a second processing for causing displaying, on the display device, the virtual presence at a suitable location with regard to the focal planes in a selected one of the other backgrounds. ## Claims ### Claim 1 A display system for a virtual local presence, comprising: a display device; an extraction engine that disassociates the virtual local presence from a production background; a first data feed of an actual background proximate to the display device; a stream subject feed of the disassociated virtual local presence; an integrated data feed in which the stream subject feed, the first data feed, and the production background are integrated; a first module executed by a processor of the display device for comparing, from the integrated data feed, a plurality of focal lengths to focal planes for the virtual local presence in the production background to a plurality of focal lengths in the actual background; and a second module executed by the processor of the display device for causing displaying on the display device of the virtual local presence in the actual background according to an output of the comparing from the first module. ### Claim 2 (depends on 1) The display system of claim 1, wherein the extraction engine is thin client. ### Claim 3 (depends on 1) The display system of claim 1, wherein the first module is thin client. ### Claim 4 (depends on 1) The display system of claim 1, wherein the second module is thin client. ### Claim 5 (depends on 1) The display system of claim 1, wherein the extraction engine further includes assessment, blocking or removal of colors. ### Claim 6 (depends on 1) The display system of claim 1, wherein the first module further includes assessment, blocking or removal of colors. ### Claim 7 (depends on 1) The display system of claim 1, wherein the extraction engine comprises motion tracking of the virtual local presence. ### Claim 8 (depends on 1) The display system of claim 1, wherein the virtual local presence is presented three-dimensionally. ### Claim 9 (depends on 1) The display system of claim 1, wherein the display device is one of augmented reality glasses, a basic video screen, or a mobile device. ### Claim 10 A display system for locally displaying a virtual presence from a remote event, comprising: a display device; an extraction engine that disassociates the virtual local presence from a production background at the remote event; a first data feed of an actual background proximate to the display device; a stream subject feed of the disassociated virtual local presence; an integrated data feed in which the stream subject feed, the first data feed, and the production background are integrated; a first module executed by a processor of the display device for comparing, from the integrated data feed, a plurality of focal lengths to focal planes for the virtual local presence at the remote event to a plurality of focal lengths in the actual background; and a second module executed by the processor of the display device for causing displaying on the display device of the virtual local presence in the actual background according to an output of the comparing from the first module. ### Claim 11 (depends on 10) The display system of claim 10, wherein the extraction engine is thin client. ### Claim 12 (depends on 10) The display system of claim 10, wherein the first module is thin client. ### Claim 13 (depends on 10) The display system of claim 10, wherein the second module is thin client. ### Claim 14 (depends on 10) The display system of claim 10, wherein the extraction engine further includes assessment, blocking or removal of colors. ### Claim 15 (depends on 10) The display system of claim 10, wherein the first module further includes assessment, blocking or removal of colors. ### Claim 16 (depends on 10) The display system of claim 10, wherein the extraction engine comprises motion tracking of the virtual local presence. ### Claim 17 (depends on 10) The display system of claim 10, wherein the virtual local presence is presented three-dimensionally. ### Claim 18 (depends on 10) The display system of claim 10, wherein the display device is one of augmented reality glasses, a basic video screen, or a mobile device. ### Claim 19 A display system for a virtual local presence, comprising: a display device; a data feed integrating a production background, the virtual local presence disassociated from the production background, and an actual background proximate to the display device; a first module executed by a processor of the display device for comparing, from the data feed, a plurality of focal lengths to focal planes for the virtual local presence in the production background to a plurality of focal lengths in the actual background; and a second module executed by the processor of the display device for causing displaying on the display device of the virtual local presence in the actual background according to an output of the comparing from the first module.