Systems and methods for collaborating physical-virtual interfaces

A method for collaborating physical-virtual interfaces, comprising:

• receiving, from a first interactive device of one or more interactive devices, first input data representing content markup of digital content from a first interactive device user of the first interactive device, the digital content to be display in a virtual environment that includes one or more human inhabited characters and a virtual device, wherein the first interactive device is physically connected to a controller, wherein the controller has a corresponding position, orientation, or rotation;
• determining a plurality of points corresponding to the content markup and a time value of the content markup, wherein the content markup includes a first markup stroke and a second markup stroke, wherein the first markup stroke includes a first starting point, a first stopping point and a first time value, wherein the second markup stroke includes a second starting point, a second stopping point and a second time value;
• and
• synchronizing display of the first input data in the virtual device in the virtual environment across the one or more interactive devices based on the plurality of points and the time value, wherein the content markup of the digital content is displayed via one or more immersive devices being used by one or more immersive device users, wherein at least one of the one or more immersive device users is different than the first interactive device user, wherein the corresponding position, orientation, or rotation of the controller is inherited by the virtual device in the virtual environment, wherein the synchronizing of the display comprises:
• comparing the first time value with the second time value;
• determining that the second time value is more recent than the first time value;
• and
• in the event that the second time value is more recent than the first time value:
• drawing the first markup stroke on a new texture;
• and
• drawing the second markup stroke on the new texture, comprising:
• identifying pixels where the first markup stroke overlaps the second markup stroke to obtain an overlapping area;
• drawing the second markup stroke in the overlapping area;
• and
• discarding pixels relating to the first markup stroke in the overlapping area.

A computing device, comprising:

• a non-transitory computer readable memory storing instructions;
• and
• a processor communicatively coupled with the non-transitory computer readable memory and configured to:
• transmit, to one or more immersive devices being used by one or more immersive device users, digital content to display in a virtual environment that includes one or more human inhabited characters and a virtual device, the digital content corresponding to content displayed on one or more interactive devices;
• receive, from a first interactive device of the one or more interactive devices, first input data representing content markup of the digital content from a first interactive device user of the first interactive device, wherein the first input data includes a first markup stroke and a second markup stroke, wherein the first markup stroke includes a first starting point, a first stopping point and a first time value, wherein the second markup stroke includes a second starting point, a second stopping point and a second time value, wherein at least one of the one or more immersive device users is different than the first interactive device user, wherein the first interactive device is physically connected to a controller, wherein the controller has a corresponding position, orientation, or rotation;
• determine an action state or an appearance state for a human inhabited character of the one or more human inhabited characters in response to the first input data;
• transmit, to the one or more immersive devices, the human inhabited character and the virtual device to display in the virtual environment according to the action state or the appearance state, wherein the action state or the appearance state for the human inhabited character is displayed via the one or more immersive devices, wherein the corresponding position, orientation, or rotation of the controller is inherited by the virtual device in the virtual environment;
• and
• synchronize the first input data across the one or more interactive devices and the one or more immersive devices, comprising to:
• compare the first time value with the second time value;
• determine that the second time value is more recent than the first time value;
• and
• in the event that the second time value is more recent than the first time value:
• draw the first markup stroke on a new texture;
• and
• draw the second markup stroke on the new texture, comprising to:
• identify pixels where the first markup stroke overlaps the second markup stroke to obtain an overlapping area;
• draw the second markup stroke in the overlapping area;
• and
• discard pixels relating to the first markup stroke in the overlapping area.

A computing device, comprising:

• a non-transitory computer readable memory storing instructions;
• and
• a processor communicatively coupled with the non-transitory computer readable memory and configured to:
• receive, from a first interactive device of one or more interactive devices, first input data representing content markup of digital content from a first interactive device user of the first interactive device, the digital content to be displayed in a virtual environment that includes one or more human inhabited characters and a virtual device, wherein the first interactive device is physically connected to a controller, wherein the controller has a corresponding position, orientation, or rotation;
• determine a plurality of points corresponding to the content markup and a time value of the content markup, wherein the content markup includes a first markup stroke and a second markup stroke, wherein the first markup stroke includes a first starting point, a first stopping point and a first time value, wherein the second markup stroke includes a second starting point, a second stopping point and a second time value;
• and
• synchronize display of the first input data in the virtual device in the virtual environment across the one or more interactive devices based on the plurality of points and the time value, wherein the content markup of the digital content is displayed via one or more immersive devices being used by one or more immersive device users, wherein at least one of the one or more immersive device users is different than the first interactive device user, wherein the corresponding position, orientation, or rotation of the controller is inherited by the virtual device in the virtual environment, wherein the synchronizing of the display comprises to:
• compare the first time value with the second time value;
• determine that the second time value is more recent than the first time value;
• and
• in the event that the second time value is more recent than the first time value:
• draw the first markup stroke on a new texture;
• and
• draw the second markup stroke on the new texture, comprising to:
• identify pixels where the first markup stroke overlaps the second markup stroke to obtain an overlapping area;
• draw the second markup stroke in the overlapping area;
• and
• discard pixels relating to the first markup stroke in the overlapping area.