# US 2017/0257594 A1 · Systems and methods for tracking objects for augmented reality > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2017/0257594 A1 - Document ID: US20170257594A1 - Status: Published application - Kind: A1 - Application number: 15/451,082 - Filed: 2017-03-06 - Published: 2017-09-07 - Earliest claimed: 2016-03-07 - Assignees: Disney Enterprises, Inc. - Applicants: Disney Enterprises, Inc. - Inventors: Michael P. Goslin; Sebastian Janisz; Matthew Ryan; Katherine M. Bassett; Joseph Olson - Web page: https://patentgrep.com/patent/US20170257594A1 ## CPC - H04N 5/44504: {Circuit details of the additional information generator, e.g. details of the character or graphics signal generator, overlay mixing circuits} - G02B 27/017: {Head mounted} - G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)} - H04N 5/2224: {related to virtual studio applications} - G02B 2027/0138: {comprising image capture systems, e.g. camera} - G02B 2027/014: {comprising information/image processing systems} - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL ## Abstract This disclosure relates to systems and methods for tracking objects for augmented reality. Positions and/or orientations of objects, light sources, and/or visual markers may be determined. Visual effects may be determined based on the objects, lights sources, and/or visual markers. Overlay positions and/or overlay orientations for the visual effects may be determined based on the positions and orientations of the objects, light sources, and/or visual markers. An overlay image including the visual effects may be determined and displayed. ## Claims ### Claim 1 A system for augmenting an appearance of an object, the system comprising: a display configured to display an overlay image; an image sensor configured to generate visual output signals conveying visual information within a field of view of the image sensor; and one or more processors configured by machine readable instructions to: determine a position of the object based on the visual output signals, the object carrying a patterned light source, the patterned light source indicating a reference point for the object that facilitates the determination of the position of the object; determine an overlay position for a visual effect based on the position of the object; determine the overlay image comprising the visual effect, wherein the visual effect is placed within the overlay image according to the overlay position for the visual effect; and effectuate displaying of the overlay image on the display so that the visual effect appears to augment the appearance of the object. ### Claim 2 (depends on 1) The system of claim 1, wherein the patterned light source includes one or more light emitting diodes. ### Claim 3 (depends on 1) The system of claim 1, wherein the patterned light source is configured to generate multiple colors of light. ### Claim 4 (depends on 1) The system of claim 1, wherein the patterned light source includes a static light pattern. ### Claim 5 (depends on 1) The system of claim 1, wherein the patterned light source includes a dynamic light pattern. ### Claim 6 (depends on 5) The system of claim 5, wherein the one or more processors are further configured by machine readable instructions to change the dynamic light pattern of the patterned light source. ### Claim 7 (depends on 1) The system of claim 1, wherein: the object carries an orientation sensor, the orientation sensor configured to generate orientation output signals conveying orientation information of the object; the one or more processors are further configured by machine readable instructions to: determine an orientation of the object based on the orientation output signals; and determine an overlay orientation for the visual effect based on the orientation of the object, wherein the visual effect is further placed within the overlay image according to the overlay orientation for the visual effect. ### Claim 8 (depends on 1) The system of claim 1, further comprising: an orientation sensor carried by the display, the orientation sensor configured to generate orientation output signals conveying orientation information of the display; the one or more processors are further configured by machine readable instructions to: determine an orientation of the display based on the orientation output signals; and determine an overlay orientation for the visual effect based on the orientation of the display, wherein the visual effect is further placed within the overlay image according to the overlay orientation for the visual effect. ### Claim 9 (depends on 1) The system of claim 1, wherein the visual effect includes an image and/or a video. ### Claim 10 A method for augmenting an appearance of an object, the method comprising: generating visual output signals conveying visual information within a field of view of an image sensor; determining a position of the object based on the visual output signals, the object carrying a patterned light source, the patterned light source indicating a reference point for the object that facilitates the determination of the position of the object; determining an overlay position for a visual effect based on the position of the object; determining an overlay image comprising the visual effect, wherein the visual effect is placed within the overlay image according to the overlay position for the visual effect; and effectuating displaying of the overlay image on a display so that the visual effect appears to augment the appearance of the object. ### Claim 11 (depends on 10) The method of claim 10, wherein the patterned light source includes one or more light emitting diodes. ### Claim 12 (depends on 10) The method of claim 10, wherein the patterned light source is configured to generate multiple colors of light. ### Claim 13 (depends on 10) The method of claim 10, wherein the patterned light source includes a static light pattern. ### Claim 14 (depends on 10) The method of claim 10, wherein the patterned light source includes a dynamic light pattern. ### Claim 15 (depends on 14) The method of claim 14, further comprising changing the dynamic light pattern of the patterned light source. ### Claim 16 (depends on 10) The method of claim 10, wherein the object carries an orientation sensor, the orientation sensor configured to generate orientation output signals conveying orientation information of the object, the method further comprising: determining an orientation of the object based on the orientation output signals; and determining an overlay orientation for the visual effect based on the orientation of the object, wherein the visual effect is further placed within the overlay image according to the overlay orientation for the visual effect. ### Claim 17 (depends on 10) The method of claim 10, wherein the display carries an orientation sensor, the orientation sensor configured to generate orientation output signals conveying orientation information of the display, the method further comprising: determining an orientation of the display based on the orientation output signals; and determining an overlay orientation for the visual effect based on the orientation of the display, wherein the visual effect is further placed within the overlay image according to the overlay orientation for the visual effect. ### Claim 18 (depends on 10) The method of claim 10, wherein the visual effect includes an image and/or a video. ### Claim 19 A system for augmenting an appearance of an object, the system comprising: a display configured to display an overlay image; an image sensor configured to generate visual output signals conveying visual information within a field of view of the image sensor; and one or more processors configured by machine readable instructions to: determine a position of the object based on the visual output signals, the object carrying a patterned light source including a dynamic light pattern, the patterned light source indicating a reference point for the object that facilitates the determination of the position of the object; change the dynamic light pattern of the patterned light source; determine an overlay position for a visual effect based on the position of the object; determine the overlay image comprising the visual effect, wherein the visual effect is placed within the overlay image according to the overlay position for the visual effect; and effectuate displaying of the overlay image on the display so that the visual effect appears to augment the appearance of the object. ### Claim 20 (depends on 9) The system of claim 9, wherein the patterned light source includes one or more light emitting diodes.