# US 11,113,897 B2 · Systems and methods for presentation of augmented reality supplemental content in combination with presentation of media content > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 11,113,897 B2 - Document ID: US11113897B2 - Status: Granted - Kind: B2 - Application number: 16/674,836 - Filed: 2019-11-05 - Published: 2020-03-05 - Granted: 2021-09-07 - Earliest claimed: 2017-10-30 - Assignees: Rovi Guides, Inc. - Applicants: Rovi Guides, Inc. - Inventors: Vikram Makam Gupta; Harsha Neerakani; Nimit Dineshbhai Kalaria - Web page: https://patentgrep.com/patent/US11113897B2 ## CPC - G06T 19/20: Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts - G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)} - H04N 21/4122: {additional display device, e.g. video projector (digital output for controlling a plurality of local displays G06F3/1423)} - H04N 21/41265: {having a remote control device for bidirectional communication between the remote control device and client device (unidirectional remote control device H04N21/42204)} - H04N 21/43079: {of additional data with content streams on multiple devices} - H04N 21/4312: {involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations} - H04N 21/4524: {involving the geographical location of the client (retrieval from the Internet by querying based on geographical locations G06F16/9537; systems specially adapted for using geographical information in broadcast systems H04H60/70; protocols in which the network application is adapted for the location of the user terminal in communication control or processing H04L67/52; services making use of the location of users or terminals in wireless networks H04W4/02; locating users or terminals in wireless networks H04W64/00)} - H04N 21/4532: {involving end-user characteristics, e.g. viewer profile, preferences (monitoring of user activities for profile generation for accessing a video database G06F16/739; user profiles in network data switching protocols H04L67/306; processing of user preferences or user profiles in wireless networks H04W8/18)} - H04N 21/4622: {Retrieving content or additional data from different sources, e.g. from a broadcast channel and the Internet (web site content organization and management for information retrieval from the Internet G06F16/958; transmission by internet of broadcast information H04H60/82; stock exchange data over packet-switching network H04L12/1804; push services including data channel over packet-switching network H04L12/1859)} - H04N 21/47214: {for content reservation or setting reminders; for requesting event notification, e.g. of sport results or stock market (stock exchange data over packet-switching network H04L12/1804; push services over packet-switching network H04L12/1859; notification of incoming messages in packet switching networks H04L51/224)} - H04N 21/4722: for requesting additional data associated with the content - G06T 2219/2004: Aligning objects, relative positioning of parts - G06V 20/20: in augmented reality scenes - G09G 2320/028: by changing the viewing angle properties, e.g. widening the viewing angle, adapting the viewing angle to the view direction - H04N 21/23418: {involving operations for analysing video streams, e.g. detecting features or characteristics (television picture signal circuitry for scene change detection H04N5/147; filtering for image enhancement G06T5/00; methods or arrangements for recognising scenes G06V20/00; arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59)} - H04N 21/4756: {for rating content, e.g. scoring a recommended movie} - H04N 21/4821: {using a grid, e.g. sorted out by channel and broadcast time} - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING - G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00) ## Abstract Systems and methods are provided herein for providing supplemental Augmented Reality (AR) content. Media content is provided to a user device located within a viewing area. A determination is made that a supplemental three dimensional (3D) AR content related to the media content is available. 3D characteristics of the supplemental AR content are determined. Such characteristics include a viewing angle and body position of an actor from the supplemental AR content. 3D characteristics of the viewing area are determined. Such characteristics include shape and position of the furniture within the viewing area and a position of a user within the viewing area. A position is determined within the viewing area by comparing the 3D characteristics of the supplemental AR content and the 3D characteristics of the viewing area. The supplemental AR content is then provided for display at the determined position. ## Claims ### Claim 1 A method for providing supplemental Augmented Reality (AR) content, the method comprising: determining a supplemental three-dimensional (3D) AR figure related to a content item, wherein the supplemental 3D AR figures comprises a representation of an actor's body; identifying furniture within a viewing area, wherein the furniture is not a display screen of a device; determining a first placement position within the viewing area for the supplemental 3D AR figure over the furniture, such that the representation of the actor's body of the supplemental 3D AR figure occupies the furniture, based on shape and position of the furniture within the viewing area, a body position of the representation of the actor's body of the supplemental 3D AR figure, and a first position of the device within the viewing area, wherein determining the first placement position comprises: determining, based on a first angle of the first position of the device within the viewing area, the first placement position; and determining, based on a second angle of a second position of the device within the viewing area, a second placement position; and providing for display the supplemental 3D AR figure in the first placement position. ### Claim 2 (depends on 1) The method of claim 1, wherein providing for display the supplemental 3D AR figure in the first placement position comprises providing for simultaneous display a current scene of the content item and the supplemental 3D AR figure. ### Claim 3 (depends on 1) The method of claim 1, wherein determining the supplemental 3D AR figure related to the content item comprises determining that a current scene of the content item is related to the supplemental 3D AR figure. ### Claim 4 (depends on 3) The method of claim 3, wherein determining that the current scene is related to the supplemental 3D AR figure comprises comparing metadata of the current scene to metadata of the supplemental 3D AR figure. ### Claim 5 (depends on 3) The method of claim 3, wherein determining that the current scene is related to the supplemental 3D AR figure comprises determining, based on a timestamp identifying the current scene, that the supplemental 3D AR figure is available at the timestamp. ### Claim 6 (depends on 1) The method of claim 1, wherein identifying furniture within the viewing area comprises determining the shape and position of the furniture. ### Claim 7 (depends on 1) The method of claim 1, wherein providing for display the supplemental 3D AR figure in the first placement position comprises: in response to the device being at the first angle, providing for display the supplemental 3D AR figure in the first placement position; and in response to the device being at the second angle, providing for display the supplemental 3D AR figure in the second placement position. ### Claim 8 (depends on 1) The method of claim 1, further comprising: determining there is no good placement position for the supplemental 3D AR content within the viewing area; and in response to determining there is no good placement position, prompting the user to adjust the position of the furniture within the viewing area. ### Claim 9 (depends on 8) The method of claim 8, further comprising: providing for display an AR phantom outline of the furniture in a preferred position within the viewing area; and prompting the user to align the furniture within the viewing area to the AR phantom outline in the preferred position. ### Claim 10 A system for providing supplemental Augmented Reality (AR) content, the system comprising: control circuitry configured to: determine a supplemental three-dimensional (3D) AR figure related to a content item, wherein the supplemental 3D AR figure comprises a representation of an actor's body; identify furniture within a viewing area, wherein the furniture is not a display screen of a device; and determine a first placement position within the viewing area for the supplemental 3D AR figure over the furniture, such that the representation of the actor's body of the supplemental 3D AR figure occupies the furniture, based on shape and position of the furniture within the viewing area, a body position of the representation of the actor's body of the supplemental 3D AR figure, and a first position of the device within the viewing area, wherein the control circuitry is configured to determine the first placement position by: determining, based on a first angle of the first position of the device within the viewing area, the first placement position; and determining, based on a second angle of a second position of the device within the viewing area, a second placement position; and output circuitry configured to provide for display the supplemental 3D AR figure in the first placement position. ### Claim 11 (depends on 10) The system of claim 10, wherein the output circuitry is configured to provide for display the supplemental 3D AR figure in the first placement position by providing for simultaneous display a current scene of the content item and the supplemental 3D AR figure. ### Claim 12 (depends on 10) The system of claim 10, wherein the control circuitry is configured to determine the supplemental 3D AR figure related to the content item by determining that a current scene of the content item is related to the supplemental 3D AR figure. ### Claim 13 (depends on 12) The system of claim 12, wherein the control circuitry is configured to determine that the current scene is related to the supplemental 3D AR figure by comparing metadata of the current scene to metadata of the supplemental 3D AR figure. ### Claim 14 (depends on 12) The system of claim 12, wherein the control circuitry is configured to determine that the current scene is related to the supplemental 3D AR figure by determining, based on a timestamp identifying the current scene, that the supplemental 3D AR figure is available at the timestamp. ### Claim 15 (depends on 10) The system of claim 10, wherein the control circuitry is configured to identify furniture within the viewing area by determining the shape and position of the furniture. ### Claim 16 (depends on 10) The system of claim 10, wherein the output circuitry is configured to provide for display the supplemental 3D AR figure in the first placement position by: in response to the device being at the first angle, providing for display the supplemental 3D AR figure in the first placement position; and in response to the device being at the second angle, providing for display the supplemental 3D AR figure in the second placement position. ### Claim 17 (depends on 10) The system of claim 10, wherein the control circuitry is further configured to: determine there is no good placement position for the supplemental 3D AR content within the viewing area; and in response to determining there is no good placement position, prompt the user to adjust the position of the furniture within the viewing area. ### Claim 18 (depends on 17) The system of claim 17, wherein: the output circuitry is further configured to provide for display an AR phantom outline of the furniture in a preferred position within the viewing area; and the control circuitry is further configured to prompt the user to align the furniture within the viewing area to the AR phantom outline in the preferred position.