# US 10,375,320 B2 · System and method for creating and manipulating synthetic environments > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,375,320 B2 - Document ID: US10375320B2 - Status: Granted - Kind: B2 - Application number: 13/600,652 - Filed: 2012-08-31 - Published: 2013-01-03 - Granted: 2019-08-06 - Earliest claimed: 2008-12-23 - Assignees: AT&T Intellectual Property I, L.P. - Applicants: Andrea Basso; Lee Begeja; David C. Gibbon; Zhu Liu; Bernard S. Renger; Behzad Shahraray - Inventors: Andrea Basso; Lee Begeja; David C. Gibbon; Zhu Liu; Bernard S. Renger; Behzad Shahraray - Web page: https://patentgrep.com/patent/US10375320B2 ## CPC - H04N 5/265: Mixing - G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)} - G06F 3/04815: Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object - G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80) - G09F 9/35: being liquid crystals (G09F9/302 takes precedence; liquid crystal materials C09K19/00; {liquid crystal panels comprising a number of electrodes in a single cell per se G02F1/13}) - G09F 19/22: Advertising or display means on roads, walls or similar surfaces, e.g. illuminated - G09F 27/00: Combined visual and audible advertising or displaying, e.g. for public address - G11B 27/034: on discs (G11B27/036, G11B27/038 take precedence) - G11B 27/105: {of operating discs} - G11B 27/34: Indicating arrangements {(indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D)} - H04N 7/163: {by receiver means only} - H04N 21/4131: {home appliance, e.g. lighting, air conditioning system, metering devices (home automation data switching networks exchanging configuration information on appliance services H04L12/2807)} - H04N 21/41415: {involving a public display, viewable by several users in a public space outside their home, e.g. movie theatre, information kiosk} - H04N 21/42203: {sound input device, e.g. microphone} - H04N 21/4223: Cameras (H04N23/00 takes precedence) - H04N 21/4312: {involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations} - H04N 21/4314: {for fitting data in a restricted space on the screen, e.g. EPG data in a rectangular grid} - H04N 21/44218: {Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV programme (methods or arrangements for recognising human body or animal bodies or body parts G06V40/10; methods or arrangements for acquiring or recognising human faces, facial parts, facial sketches, facial expressions G06V40/16; methods or arrangements for recognising movements or behaviour G06V40/20; arrangements for identifying users in broadcast systems H04H60/45)} - H04N 21/4532: {involving end-user characteristics, e.g. viewer profile, preferences (monitoring of user activities for profile generation for accessing a video database G06F16/739; user profiles in network data switching protocols H04L67/306; processing of user preferences or user profiles in wireless networks H04W8/18)} - H04N 21/45452: {applied to an object-based stream, e.g. MPEG-4 streams} - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - G09F: DISPLAYING; ADVERTISING; SIGNS; LABELS OR NAME-PLATES; SEALS - G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R) ## Abstract Disclosed herein are systems, computer-implemented methods, and tangible computer-readable media for synthesizing a virtual window. The method includes receiving an environment feed, selecting video elements of the environment feed, displaying the selected video elements on a virtual window in a window casing, selecting non-video elements of the environment feed, and outputting the selected non-video elements coordinated with the displayed video elements. Environment feeds can include synthetic and natural elements. The method can further toggle the virtual window between displaying the selected elements and being transparent. The method can track user motion and adapt the displayed selected elements on the virtual window based on the tracked user motion. The method can further detect a user in close proximity to the virtual window, receive an interaction from the detected user, and adapt the displayed selected elements on the virtual window based on the received interaction. ## Claims ### Claim 1 A method comprising: based on a first position of a user relative to a device: presenting a first image on an image plane of the device; and presenting a second image on the image plane of the device, the first image and the second image comprising a first composite image that presents a first relative relationship between the first image and the second image according to a first view by the user of the first composite image from the first position, and wherein neither the first image nor the second image is an image of the user; detecting that the user has moved from the first position to a second position relative to the device to yield a second view by the user of the device from the second position, wherein the device does not move; and based on the second position and based on the second view from the second position, modifying the first image on the image plane and modifying the second image on the image plane to yield a modified first image and a modified second image, wherein the modified first image and the modified second image yield a second composite image that is configured based on the second view by the user of the second composite image from the second position. ### Claim 2 (depends on 1) The method of claim 1, wherein the second image comprises synthetic and natural components. ### Claim 3 (depends on 1) The method of claim 1, wherein the second image comprises data associated with one of sound, smell, humidity, temperature, and wind elements. ### Claim 4 (depends on 1) The method of claim 1, further comprising: receiving a user profile of the user; and selecting video and non-video elements of the second image based on the user profile. ### Claim 5 (depends on 4) The method of claim 4, wherein the selecting of the video and the non-video elements of the second image is further based on an advertiser. ### Claim 6 (depends on 1) The method of claim 1, further comprising: coordinating the outputting of the second image and the modified view with a third image. ### Claim 7 (depends on 1) The method of claim 1, wherein the outputting of the second image is time delayed such that the outputting of the second image and the modified view occur in a local time of the feed reception physical location when the local time matches a feed time of the physical location when the second image was recorded. ### Claim 8 A system comprising: a processor; and a computer-readable storage medium having instructions stored which, when executed by the processor, cause the processor to perform operations comprising: based on a first position of a user relative to a device: presenting a first image on an image plane of the device; and presenting a second image on the image plane of the device, the first image and the second image comprising a first composite image that presents a first relative relationship between the first image and the second image according to a first view by the user of the first composite image from the first position, and wherein neither the first image nor the second image is an image of the user; detecting that the user has moved from the first position to a second position relative to the device to yield a second view by the user of the device from the second position, wherein the device does not move; and based on the second position and based on the second view from the second position, modifying the first image on the image plane and modifying the second image on the image plane to yield a modified first image and a modified second image, wherein the modified first image and the modified second image yield a second composite image that is configured based on the second view by the user of the second composite image from the second position. ### Claim 9 (depends on 8) The system of claim 8, wherein the second image comprises synthetic and natural components. ### Claim 10 (depends on 8) The system of claim 8, wherein the second image comprises data associated with one of sound, smell, humidity, temperature, and wind elements. ### Claim 11 (depends on 8) The system of claim 8, the computer-readable storage medium having additional instructions stored which, when executed by the processor, result in operations comprising: receiving a user profile of the user; and selecting video and non-video elements of the second image based on the user profile. ### Claim 12 (depends on 11) The system of claim 11, wherein the selecting of the video and the non-video elements of the second image is further based on an advertiser. ### Claim 13 (depends on 8) The system of claim 8, the computer-readable storage medium having additional instructions stored which, when executed by the processor, result in operations comprising: coordinating the outputting of the second image and the modified view with a third image. ### Claim 14 (depends on 8) The system of claim 8, wherein the outputting of the second image time delayed such that the outputting of the second image and the modified view occur in a local time of the feed reception physical location when the local time matches a feed time of the physical location when the second image was recorded. ### Claim 15 A computer-readable storage device having instructions stored which, when executed by a computing device, cause the computing device to perform operations comprising: based on a first position of a user relative to a device: presenting a first image on an image plane of the device; and presenting a second image on the image plane of the device, the first image and the second image comprising a first composite image that presents a first relative relationship between the first image and the second image according to a first view by the user of the first composite image from the first position, and wherein neither the first image nor the second image is an image of the user; detecting that the user has moved from the first position to a second position relative to the device to yield a second view by the user of the device from the second position, wherein the device does not move; and based on the second position and based on the second view from the second position, modifying the first image on the image plane and modifying the second image on the image plane to yield a modified first image and a modified second image, wherein the modified first image and the modified second image yield a second composite image that is configured based on the second view by the user of the second composite image from the second position. ### Claim 16 (depends on 15) The computer-readable storage device of claim 15, wherein the second image comprises synthetic and natural components. ### Claim 17 (depends on 15) The computer-readable storage device of claim 15, wherein the second image comprises data associated with one of sound, smell, humidity, temperature, and wind elements. ### Claim 18 (depends on 15) The computer-readable storage device of claim 15, having additional instructions stored which, when executed by the computing device, result in operations comprising: receiving a user profile of the user; and selecting video and non-video elements of the second image based on the user profile. ### Claim 19 (depends on 18) The computer-readable storage device of claim 18, wherein the selecting of the video and the non-video elements of the second image is further based on an advertiser. ### Claim 20 (depends on 15) The computer-readable storage device of claim 15, having additional instructions stored which, when executed by the computing device, result in operations comprising: coordinating the outputting of the second image and modified view with a third image.