# US 2017/0287007 A1 · Real-time and context based advertisement with augmented reality enhancement > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2017/0287007 A1 - Document ID: US20170287007A1 - Status: Published application - Kind: A1 - Application number: 15/479,277 - Filed: 2017-04-04 - Published: 2017-10-05 - Earliest claimed: 2016-04-03 - Applicants: Integem Inc. - Inventors: Eliza Y. DU - Web page: https://patentgrep.com/patent/US20170287007A1 ## CPC - G06Q 30/0261: {based on user location} - G06Q 30/0241: Advertisements - G06Q 30/0271: {Personalized advertisement} - G06Q 30/0276: {Advertisement creation} - G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)} - G06T 19/20: Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts - G06V 20/20: in augmented reality scenes - G06V 20/40: in video content (extracting overlay text G06V20/62; video retrieval G06F16/70; processing of video elementary streams in video servers H04N21/234; processing of video elementary streams in video clients H04N21/44) - G06Q 30/0269: {based on user profile or attribute} - H04N 7/15: Conference systems - G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract Disclosed herein are methods and systems for real-time content-matched advertisement in an augmented reality environment. In particular, a plurality of integrated images of an extracted real life object in a virtual environment is provided at a computer device to a user. The plurality of integrated images comprises one or more advertisement elements that are determined using a comprehensive content matching mechanism. The comprehensive content matching mechanism is based on a plurality of factors comprising advertisement content, user preference information, and context information. ## Claims ### Claim 1 A method for providing immersive advertisement, comprising: providing, at a computer device to a user, a plurality of integrated images of an extracted real life object in a virtual environment, the plurality of integrated images comprising one or more advertisement elements, the one or more advertisement elements being determined using a comprehensive content matching mechanism; wherein the comprehensive content matching mechanism is based on a plurality of factors comprising advertisement content, user preference information, and context information. ### Claim 2 (depends on 1) The method of claim 1, wherein the user preference information comprises user specified information, user biographical information, user behavior information, user activities, user psychological status, user socioeconomic status, user real-time request information, or combinations thereof. ### Claim 3 (depends on 1) The method of claim 1, wherein the context information comprises date and time information, communication context, content context, advertiser context, geolocation context, presentation context, or combinations thereof. ### Claim 4 (depends on 1) The method of claim 1, further comprising: identifying the user preference information, the user preference information comprising user specified information, user biographical information, user behavior information, user activities, user psychological status, user socioeconomic status, user real-time request information, or combinations thereof; identifying the context information, the context information comprising communication context, content context, advertiser context, location context, or presentation context; and determining the one or more advertisement elements by searching a collection of advertisement content based on the user preference information and the context information. ### Claim 5 (depends on 4) The method of claim 4, wherein the determining step further comprises: determining the one or more advertisement elements based on the advertiser context. ### Claim 6 (depends on 5) The method of claim 5, wherein the advertiser context comprises advertiser-specified content matching criteria including favored or disfavored presentation forums or pricing information. ### Claim 7 (depends on 5) The method of claim 5, wherein the one or more advertisement elements are determined in a bidding process. ### Claim 8 (depends on 1) The method of claim 1, wherein the extracted real life object comprises multi-dimensional image information extracted by separating a real life object from its actual environment in one or more real-time captured images using a comprehensive characteristic-based mechanism, and the virtual environment is constructed from a plurality of images; and wherein each pixel in an integrated image is divided into multiple layers, each layer determined using corresponding pixels in the extracted real life object and each image of the plurality of images of the virtual environment based on image relations between each pixel of the extracted real life object and a corresponding pixel of each image of the plurality of images of the virtual environment, the image relations comprising at least a depth relation or a transparency relation. ### Claim 9 (depends on 8) The method of claim 8, wherein the one or more advertisement elements are embedded into the plurality of integrated images in real-time when extracting image information of the real life object, constructing the virtual environment, or determining layers of pixels in an integrated image. ### Claim 10 (depends on 1) The method of claim 1, comprising: providing, at the computer device and in real-time, one or more audio tracks, the one or more audio tracks comprising audio information associated with the plurality of integrated images. ### Claim 11 (depends on 1) The method of claim 1, wherein the plurality of integrated images forms a video comprising one or more audio tracks. ### Claim 12 (depends on 11) The method of claim 11, wherein the one or more audio tracks comprise audio information concerning the one or more advertisement elements. ### Claim 13 (depends on 11) The method of claim 11, wherein the one or more audio tracks comprise a translation audio track of the built-in audio track, the translation audio track being automatically selected in real-time from audio tracks in multiple languages based on the geographic location or a pre-determined setting of the computer device. ### Claim 14 (depends on 1) The method of claim 1, wherein the one or more advertisement elements are associated with a product or a service. ### Claim 15 (depends on 1) The method of claim 1, wherein the extracted real life object is selected from a plurality of extracted real life objects based on geographic location of the computer device or a preference set by a user of the computer device. ### Claim 16 (depends on 15) The method of claim 15, wherein the plurality of extracted real life objects includes a celebrity, an actor, an athlete, or a user of the computer device. ### Claim 17 (depends on 1) The method of claim 1, wherein the extracted real life object interacts with one or more elements of the virtual environment in the plurality of integrated images. ### Claim 18 (depends on 1) The method of claim 1, wherein the virtual environment comprises an element reflecting the location of the computer device. ### Claim 19 A computer system comprising: one or more processors; and a memory accessible to the one or more processors, the memory storing instructions executable by the one or more processors to: provide, at a computer device to a user, a plurality of integrated images of an extracted real life object in a virtual environment, the plurality of integrated images comprising one or more advertisement elements, the one or more advertisement elements being determined using a comprehensive content matching mechanism; wherein the comprehensive content matching mechanism is based on a plurality of factors comprising advertisement content, user preference information, and context information. ### Claim 20 A non-transitory computer-readable medium containing instructions that, when executed by a computer processor, cause the computer processor to: provide, at a computer device to a user, a plurality of integrated images of an extracted real life object in a virtual environment, the plurality of integrated images comprising one or more advertisement elements, the one or more advertisement elements being determined using a comprehensive content matching mechanism; wherein the comprehensive content matching mechanism is based on a plurality of factors comprising advertisement content, user preference information, and context information.