# US 2018/0025544 A1 · Method and device for determining rendering information for virtual content in augmented reality > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2018/0025544 A1 - Document ID: US20180025544A1 - Status: Published application - Kind: A1 - Application number: 15/217,667 - Filed: 2016-07-22 - Published: 2018-01-25 - Earliest claimed: 2016-07-22 - Inventors: Philipp A. SCHOELLER; Theo CHUPP - Web page: https://patentgrep.com/patent/US20180025544A1 ## CPC - G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)} - G06T 7/74: {involving reference images or patches} - G06V 10/242: {by image rotation, e.g. by 90 degrees} - G06V 20/20: in augmented reality scenes - G06T 2207/30204: Marker - G06V 10/245: {by locating a pattern; Special marks for positioning} - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING ## Abstract The present invention relates to techniques for determining rendering information for virtual content within an augmented reality. The technique may comprise capturing an image comprising a graphical tag by an image capturing unit, wherein the graphical tag comprises one or more geometric objects, and the graphical tag representing coded information. Size reference information may then be obtained from the captured image and a distortion of a captured view of one of the geometric objects may then be determined. Thereafter, based on the size reference information and the distortion of the captured view, a relative position of the graphical tag to the image capturing unit may be determined. Based on the determined relative position, positioning information and scaling information for rendering the virtual content within an augmented reality relative to the graphical tag may then be determined. ## Claims ### Claim 1 A computer-implemented method for determining rendering information for virtual content within an augmented reality, the method comprising: capturing an image comprising a graphical tag by an image capturing unit, wherein the graphical tag comprises one or more geometric objects, and the graphical tag representing coded information; obtaining from the captured image size reference information; determining a distortion of a captured view of at least one of said geometric objects; determining, based on the size reference information and the distortion of the captured view, a relative position of the graphical tag to the image capturing unit; and determining, based on the determined relative position, positioning information and scaling information for rendering the virtual content within an augmented reality relative to the graphical tag. ### Claim 2 (depends on 1) The computer-implemented method of claim 1, further comprising rendering the virtual content within the augmented reality using the determined positioning information and scaling information. ### Claim 3 (depends on 1) The computer-implemented method of claim 1, wherein said coded information comprises a source for the virtual content and/or the size reference information. ### Claim 4 (depends on 1) The computer-implemented method of claim 1, wherein determining the relative position of the graphical tag to the image capturing unit comprises determining a distance, a direction and an angle between the graphical tag and the image capturing unit. ### Claim 5 (depends on 1) The computer-implemented method of claim 1, wherein determining the relative position of the graphical tag to the image capturing device comprises determining a degree of distortion and a direction of distortion of the one or more geometric objects, wherein the degree of distortion is determined by analyzing an aspect ratio of at least one of said one or more geometric objects. ### Claim 6 (depends on 1) The computer-implemented method of claim 1, wherein the determining the positioning information and scaling information comprises dynamically updating the orientation of the virtual content by updating the positioning information and scaling information when the relative position of the graphical tag and the image capturing unit changes. ### Claim 7 (depends on 1) The computer-implemented method of claim 1, wherein the coded information further comprises an indication of a category of the virtual content. ### Claim 8 A device for determining rendering information for virtual content within an augmented reality, the device comprising: an image capturing unit for capturing an image comprising a graphical tag, wherein the graphical tag comprises one or more geometric objects, and the graphical tag representing coded information; and a processing unit configured to: obtaining from the captured image size reference information; determining a distortion of a captured view of at least one of said geometric objects; determining, based on the size reference information and the distortion of the captured view, a relative position of the graphical tag to the image capturing unit; and determining, based on the determined relative position, positioning information and scaling information for rendering the virtual content within an augmented reality relative to the graphical tag. ### Claim 9 (depends on 8) The device of claim 8, further comprising a rendering unit for rendering the virtual content within the augmented reality using the determined positioning information and scaling information. ### Claim 10 (depends on 8) The device of claim 8, wherein said coded information comprises a source for the virtual content and/or the size reference information. ### Claim 11 (depends on 8) The device of claim 8, wherein determining the relative position of the graphical tag to the image capturing unit comprises determining a distance, a direction and an angle between the graphical tag and the image capturing unit. ### Claim 12 (depends on 8) The device of claim 8, wherein determining the relative position of the graphical tag to the image capturing device comprises determining a degree of distortion and a direction of distortion of the one or more geometric objects, wherein the degree of distortion is determined by analyzing an aspect ratio of at least one of said one or more geometric objects. ### Claim 13 (depends on 8) The device of claim 8, wherein the determining the positioning information and scaling information comprises dynamically updating the orientation of the virtual content by updating the positioning information and scaling information when the relative position of the graphical tag and the image capturing unit changes. ### Claim 14 (depends on 8) The device of claim 8, wherein the coded information further comprises an indication of a category of the virtual content.