# US 2018/0027272 A1 · Method and system for contextually aware media augmentation > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2018/0027272 A1 - Document ID: US20180027272A1 - Status: Published application - Kind: A1 - Application number: 15/654,581 - Filed: 2017-07-19 - Published: 2018-01-25 - Earliest claimed: 2016-07-19 - Inventors: Tarun Sunder Raj; Benjamin Tucker - Web page: https://patentgrep.com/patent/US20180027272A1 ## CPC - H04N 21/25891: {being end-user preferences (retrieval of video data in a video database based on user preferences G06F16/739; arrangements for recognizing users' preferences H04H60/46; user profiles in network data switching protocols H04L67/306; processing of user preferences or user profiles in wireless networks H04W8/18)} - H04N 21/422: Input-only peripherals {, i.e. input devices connected to specially adapted client devices}, e.g. global positioning system [GPS] {(input devices also receiving signals from specially adapted client devices H04N21/4104)} - H04N 21/23424: {involving splicing one content stream with another content stream, e.g. for inserting or substituting an advertisement} - H04N 21/43072: {of multiple content streams on the same device} - H04N 21/43074: {of additional data with content streams on the same device, e.g. of EPG data or interactive icon with a TV programme} - H04N 21/44008: {involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream (arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59)} - H04N 21/44224: {Monitoring of user activity on external systems, e.g. Internet browsing} - H04N 21/44226: {on social networks} - H04N 21/4532: {involving end-user characteristics, e.g. viewer profile, preferences (monitoring of user activities for profile generation for accessing a video database G06F16/739; user profiles in network data switching protocols H04L67/306; processing of user preferences or user profiles in wireless networks H04W8/18)} - H04N 21/632: {using a connection between clients on a wide area network, e.g. setting up a peer-to-peer communication via Internet for retrieving video segments from the hard-disk of other client devices (broadcast-related systems characterised by transmission among terminal devices H04H60/80; distributed application using peer-to-peer [P2P] networks H04L67/104)} - H04N 21/8133: {specifically related to the content, e.g. biography of the actors in a movie, detailed information about an article seen in a video programme} - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract Disclosed is a method of providing augmented media content. The method may include receiving, using a communication unit, a media content and at least one broadcaster preference from a broadcaster device. Further, the method may include retrieving, using the communication unit, a plurality of augmentation content based on the at least one broadcaster preference. Further, the method may include transmitting, using the communication unit, the plurality of augmentation content to the broadcaster device. Further, the method may include receiving, using the communication unit, a selection of at least one augmentation content from the broadcaster device. Further, the method may include embedding, using a processing unit, the at least one augmentation content and the at least one broadcaster preference in the media content to obtain an augmented media content. Further, the method may include transmitting, using the communication unit, the augmented media content to the broadcaster device. ## Claims ### Claim 1 A method of providing augmented media content, the method comprising: receiving, using a communication unit, a media content from a broadcaster device; receiving, using the communication unit, at least one broadcaster preference from the broadcaster device, wherein the broadcaster preference comprises at least one viewer context variable; retrieving, using the communication unit, a plurality of augmentation content from at least one database based on the at least one broadcaster preference; transmitting, using the communication unit, the plurality of augmentation content to the broadcaster device, wherein the broadcaster device is configured to present the plurality of augmentation content; receiving, using the communication unit, a selection of at least one augmentation content from the broadcaster device; embedding, using a processing unit, each of the at least one augmentation content and the at least one viewer context variable in the media content to obtain an augmented media content, wherein presenting of the augmented media content on a viewer device is based on at least one viewer context value corresponding to the at least one viewer context variable, wherein the at least one viewer context value is associated with the viewer device; and transmitting, using the communication unit, the augmented media content to the broadcaster device. ### Claim 2 (depends on 1) The method of claim 1 further comprising receiving, using the communication unit, at least one broadcaster context value corresponding to at least one broadcaster context variable from the broadcaster device, wherein the retrieving of the plurality of augmentation content is further based on the at least one broadcaster context value. ### Claim 3 (depends on 2) The method of claim 2, wherein the at least one broadcaster context variable corresponds to at least one broadcaster sensor comprised in the broadcaster device, wherein the at least one viewer context variable corresponds to at least one viewer sensor comprised in the viewer device. ### Claim 4 (depends on 1) The method of claim 1 further comprising: analyzing, using the processing unit, the media content; and identifying, using the processing unit, at least one interaction element in the media content based on the analyzing, wherein the retrieving of the plurality of augmentation content is further based on the at least one interaction element. ### Claim 5 (depends on 1) The method of claim 1 further comprising receiving, using the communication unit, viewer interaction data from the viewer device, wherein the viewer interaction data represents interaction of a viewer with the viewer device in association with the augmented content presented on the viewer device, wherein the retrieving of the plurality of augmentation content is further based on the viewer interaction data. ### Claim 6 (depends on 1) The method of claim 1 further comprising receiving, using the communication unit, at least one viewer preference from the viewer device, wherein the retrieving of the plurality of augmentation content is further based on the at least one viewer preference. ### Claim 7 (depends on 1) The method of claim 1, wherein presenting of the augmented media content on the viewer device is based further on at least one viewer preference. ### Claim 8 (depends on 1) The method of claim 1 further comprising receiving, using the communication unit, at least one time indicator from the broadcaster device, wherein the at least one time indicator is associated with play time of the media content, wherein the embedding of the augmentation content is based on the at least one time indicator, wherein presenting of the augmentation content associated with a time indicator is synchronous with presenting of the media content corresponding to the time indicator. ### Claim 9 (depends on 1) The method of claim 1, wherein the at least one broadcaster preference comprises a conditional statement specifying a condition based on the at least one viewer context variable and an associated augmentation content, wherein the associated augmentation content is retrieved by the viewer device based on the conditional statement. ### Claim 10 (depends on 1) The method of claim 1 further comprising: receiving, using the communication unit, at least one auto-response content from the broadcaster device, wherein the at least one auto-response content is associated with the augmentation content; and embedding, using the processing unit, the at least one auto-response content in the media content, wherein the at least one auto-response content is transmitted to at least one communication device associated with the viewer device based on an interaction of a viewer with the viewer device in association with the augmentation content. ### Claim 11 A system for providing augmented media content, the system comprising: a communication unit configured for: receiving a media content from a broadcaster device; receiving at least one broadcaster preference from the broadcaster device, wherein the broadcaster preference comprises at least one viewer context variable; retrieving a plurality of augmentation content from at least one database based on the at least one broadcaster preference; transmitting the plurality of augmentation content to the broadcaster device, wherein the broadcaster device is configured to present the plurality of augmentation content; receiving a selection of at least one augmentation content from the broadcaster device; transmitting the augmented media content to the broadcaster device; and a processing unit configured for embedding each of the at least one augmentation content and the at least one viewer context variable in the media content to obtain an augmented media content, wherein presenting of the augmented media content on a viewer device is based on at least one viewer context value corresponding to the at least one viewer context variable, wherein the at least one viewer context value is associated with the viewer device. ### Claim 12 (depends on 11) The system of claim 11, wherein the communication unit is further configured for receiving at least one broadcaster context value corresponding to at least one broadcaster context variable from the broadcaster device, wherein the retrieving of the plurality of augmentation content is further based on the at least one broadcaster context value. ### Claim 13 (depends on 12) The system of claim 12, wherein the at least one broadcaster context variable corresponds to at least one broadcaster sensor comprised in the broadcaster device, wherein the at least one viewer context variable corresponds to at least one viewer sensor comprised in the viewer device. ### Claim 14 (depends on 11) The system of claim 11, wherein the processing unit is further configured for: analyzing the media content; and identifying at least one interaction element in the media content based on the analyzing, wherein the retrieving of the plurality of augmentation content is further based on the at least one interaction element. ### Claim 15 (depends on 1) The system of claim 1, wherein the communication unit is further configured for receiving viewer interaction data from the viewer device, wherein the viewer interaction data represents interaction of a viewer with the viewer device in association with the augmented content presented on the viewer device, wherein the retrieving of the plurality of augmentation content is further based on the viewer interaction data. ### Claim 16 (depends on 11) The system of claim 11, wherein the communication unit is further configured for receiving at least one viewer preference from the viewer device, wherein the retrieving of the plurality of augmentation content is further based on the at least one viewer preference. ### Claim 17 (depends on 11) The system of claim 11, wherein presenting of the augmented media content on the viewer device is based further on at least one viewer preference. ### Claim 18 (depends on 11) The system of claim 11, wherein the communication unit is further configured for receiving at least one time indicator from the broadcaster device, wherein the at least one time indicator is associated with play time of the media content, wherein the embedding of the augmentation content is based on the at least one time indicator, wherein presenting of the augmentation content associated with a time indicator is synchronous with presenting of the media content corresponding to the time indicator. ### Claim 19 (depends on 11) The system of claim 11, wherein the at least one broadcaster preference comprises a conditional statement specifying a condition based on the at least one viewer context variable and an associated augmentation content, wherein the associated augmentation content is retrieved by the viewer device based on the conditional statement. ### Claim 20 (depends on 11) The system of claim 11, wherein the communication unit is further configured for receiving at least one auto-response content from the broadcaster device, wherein the at least one auto-response content is associated with the augmentation content, wherein the processing unit is further configured for embedding the at least one auto-response content in the media content, wherein the at least one auto-response content is transmitted to at least one communication device associated with the viewer device based on an interaction of a viewer with the viewer device in association with the augmentation content. ### Claim 21 A method of providing augmented media content, the method comprising: receiving, using the processing unit, at least one broadcaster preference; receiving, using a processing unit, a media content from a media source; analyzing, using the processing unit, the media content; identifying, using the processing unit, at least one interaction element in the media content based on the analyzing; identifying, using the processing unit, at least one augmentation content based on each of the at least one interaction element and the at least one broadcaster preference; embedding, using the processing unit, the at least one augmentation content in the media content to obtain an augmented media content; and transmitting, using a communication unit, the augmented media content to a viewer device, wherein the viewer device is configured to present the media content, wherein the viewer device is associated with at least one viewer preference and at least one viewer contextual data, wherein presenting of the at least one augmentation content is based on the at least one viewer preference and the at least one viewer contextual data. ### Claim 22 A method of providing augmented media content, the method comprising: receiving, using a communication unit, a media content from a broadcaster device; receiving, using the communication unit, at least one broadcaster contextual data from the broadcaster device, wherein the at least one broadcaster contextual data is associated with at least one of the media content and a broadcaster associated with the user device; analyzing, using a processing unit, at least one of the media content and the at least one broadcaster contextual data; identifying, using the processing unit, a plurality of augmentation content based on the analyzing; transmitting, using the communication unit, the plurality of augmentation content to the broadcaster device; receiving, using the communication unit, a selection of at least one augmentation content from the plurality of augmentation content; embedding, using the processing, at least one of the at least one augmentation content in the media content to obtain an augmented media content; and transmitting, using the communication unit, the augmented media content to the broadcaster device.