# US 10,482,673 B2 · System and method for role negotiation in multi-reality environments > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,482,673 B2 - Document ID: US10482673B2 - Status: Granted - Kind: B2 - Application number: 15/908,082 - Filed: 2018-02-28 - Published: 2018-11-08 - Granted: 2019-11-19 - Earliest claimed: 2013-06-27 - Assignees: Help Lightning, Inc. - Applicants: Help Lightning, Inc. - Inventors: Marcus W. Dillavou; Matthew Benton May - Web page: https://patentgrep.com/patent/US10482673B2 ## CPC - G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)} - G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)} - G06T 19/00: Manipulating three-dimensional [3D] models or images for computer graphics - A63F 13/65: automatically by game devices or servers from real world data, e.g. measurement in live racing competition - A63F 2300/8082: Virtual reality - G06T 2219/024: Multi-user, collaborative environment - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - A63F: CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR ## Abstract Provided herein are methods and systems for role negotiation with multiple sources. A method for role negotiation can comprise rendering a common field of interest that reflects a presence of a plurality of elements, wherein at least one of the elements is a remote element located remotely from another of the elements. A plurality of role designations can be received, each role designation associated with one of a plurality of devices, wherein at least one of the plurality of devices is a remote device located remotely from another of the plurality of devices. The common field of interest can be updated based upon the plurality of role designations, wherein each of the plurality of role designations defines an interactive functionality associated with the respective device of the plurality of devices. ## Claims ### Claim 1 A method for role negotiation comprising: rendering a common field of interest that reflects a presence of a plurality of elements, wherein at least one of the elements is a remote element located remotely from another of the elements; receiving a plurality of role designations, each role designation associated with one of a plurality of devices, wherein at least one of the plurality of devices is a remote device located remotely from another of the plurality of devices; updating the common field of interest based upon the plurality of role designations, wherein each of the plurality of role designations defines an interactive functionality associated with the respective device of the plurality of devices; receiving a role change request from a first device of the plurality of devices, wherein the role change request comprises a desired role and the desired role is independent of a location of the first device; granting the role change request based upon one or more role designation rules; updating the role designation associated with the first device to match the desired role in response to the granting the role change request; outputting the common field of interest based on the updated role designation such that a display parameter of the common field of interest is dependent upon the updated role designation; and establishing one or more communication links between the first device and one or more other devices of the plurality of devices, wherein the communication links are configured to facilitate one of unidirectional and multidirectional transmission based on the updated role designation associated with the first device and the role designation of at least one other of the plurality of devices; wherein each of the role designations represents a construct that triggers a logical execution of one or more programs that, upon execution, affect one or more settings including: the processing of image, audio, or video information presented to a user, the transmission of images, audio, and/or video presented to a user, and the presentation of a graphical user interface presented to a user; wherein the settings are applied upon granting of the role change request; wherein the role designation associated with the first device comprises one of a giver of help role and a receiver of help role, and wherein the role designation of at least one other of the plurality of devices comprises one of the giver of help role and the receiver of help role not currently associated with the first device; and wherein, when the giver of help role is designated, at least a portion of a local background is subtracted from a local image to generate a local element of the plurality of elements, and wherein the common field of interest comprises the local element. ### Claim 2 (depends on 1) The method of claim 1, further comprising rendering the presence of each of the elements in real time, wherein each of the elements is registered relative to another of the elements. ### Claim 3 (depends on 1) The method of claim 1, further comprising the step of rendering interaction between the elements in the common field of interest. ### Claim 4 (depends on 1) The method of claim 1, wherein interactive functionality comprises one or more of sending and receiving image data and wherein one or more of the plurality of role designations define a different interactive functionality compared to another of the role designations. ### Claim 5 (depends on 1) The method of claim 1, further comprising the step of calibrating the common field of interest by aligning a calibration feature of a remote field and a calibration feature of a local field. ### Claim 6 (depends on 1) The method of claim 1, wherein updating the common field of interest comprises modifying a display characteristic of one or more of the remote element and the local element. ### Claim 7 (depends on 1) The method of claim 1, wherein one or more of the plurality of role designations define a different transmission rule compared to another of the role designations. ### Claim 8 (depends on 1) The method of claim 1, wherein the information comprises one or more of audio information and image information. ### Claim 9 A method for role negotiation comprising: rendering a common field of interest that reflects a presence of a plurality of elements, wherein at least one of the elements is a remote element located remotely from another of the elements; receiving a plurality of role designations, each role designation associated with one of a plurality of devices, wherein at least one of the plurality of devices is a remote device located remotely from another of the plurality of devices; updating the common field of interest based upon the plurality of role designations, wherein each of the plurality of role designations defines an interactive functionality associated with the respective device of the plurality of devices; receiving a role change request from a first device of the plurality of devices, wherein the role change request comprises a desired role and the desired role is independent of a location of the first device; granting the role change request based upon one or more role designation rules; updating the role designation associated with the first device to match the desired role in response to the granting the role change request; outputting the common field of interest based on the updated role designation such that a display parameter of the common field of interest is dependent upon the updated role designation; and establishing one or more communication links between the first device and one or more other devices of the plurality of devices, wherein the communication links are configured to facilitate one of unidirectional and multidirectional transmission based on the updated role designation associated with the first device and the role designation of at least one other of the plurality of devices; wherein each of the role designations represents a construct that triggers a logical execution of one or more programs that, upon execution, affect one or more settings including: the processing of image, audio, or video information presented to a user, the transmission of images, audio, and/or video presented to a user, and the presentation of a graphical user interface presented to a user; wherein the settings are applied upon granting of the role change request; wherein the role designation associated with the first device comprises one of a giver of help role and a receiver of help role, and wherein the role designation of at least one other of the plurality of devices comprises one of the giver of help role and the receiver of help role not currently associated with the first device; and wherein, when the giver of help role is designated, at least a portion of a local background is removed from a local image to generate a local element of the plurality of elements, and wherein the common field of interest comprises the local element. ### Claim 10 (depends on 9) The method of claim 9, further comprising rendering the presence of each of the elements in real time, wherein each of the elements is registered relative to another of the elements. ### Claim 11 (depends on 9) The method of claim 9, further comprising the step of rendering interaction between the elements in the common field of interest. ### Claim 12 (depends on 9) The method of claim 9, wherein interactive functionality comprises one or more of sending and receiving image data and wherein one or more of the plurality of role designations define a different interactive functionality compared to another of the role designations. ### Claim 13 (depends on 9) The method of claim 9, wherein updating the common field of interest comprises modifying a display characteristic of one or more of the remote element and the local element. ### Claim 14 (depends on 9) The method of claim 9, wherein the information comprises one or more of audio information and image information. ### Claim 15 A method for role negotiation comprising: rendering a common field of interest that reflects a presence of a plurality of elements, wherein at least one of the elements is a remote element located remotely from another of the elements; receiving a plurality of role designations, each role designation associated with one of a plurality of devices, wherein at least one of the plurality of devices is a remote device located remotely from another of the plurality of devices; updating the common field of interest based upon the plurality of role designations, wherein each of the plurality of role designations defines an interactive functionality associated with the respective device of the plurality of devices; receiving a role change request from a first device of the plurality of devices, wherein the role change request comprises a desired role and the desired role is independent of a location of the first device; granting the role change request based upon one or more role designation rules; updating the role designation associated with the first device to match the desired role in response to the granting the role change request; outputting the common field of interest based on the updated role designation such that a display parameter of the common field of interest is dependent upon the updated role designation; and establishing one or more communication links between the first device and one or more other devices of the plurality of devices, wherein the communication links are configured to facilitate one of unidirectional and multidirectional transmission based on the updated role designation associated with the first device and the role designation of at least one other of the plurality of devices; wherein each of the role designations represents a construct that triggers a logical execution of one or more programs that, upon execution, affect one or more settings including: the processing of image, audio, or video information presented to a user, the transmission of images, audio, and/or video presented to a user, and the presentation of a graphical user interface presented to a user; wherein the settings are applied upon granting of the role change request; wherein the role designation associated with the first device comprises one of a giver of help role and a receiver of help role, and wherein the role designation of at least one other of the plurality of devices comprises one of the giver of help role and the receiver of help role not currently associated with the first device; and wherein, when the giver of help role is designated, a local object is determined from a local image and a portion of the local image distinct from the local object is removed from the local image to generate a local element of the plurality of elements, and wherein the common field of interest comprises the local element. ### Claim 16 (depends on 15) The method of claim 15, further comprising rendering the presence of each of the elements in real time, wherein each of the elements is registered relative to another of the elements. ### Claim 17 (depends on 15) The method of claim 15, further comprising the step of rendering interaction between the elements in the common field of interest. ### Claim 18 (depends on 15) The method of claim 15, wherein interactive functionality comprises one or more of sending and receiving image data and wherein one or more of the plurality of role designations define a different interactive functionality compared to another of the role designations. ### Claim 19 (depends on 15) The method of claim 15, wherein updating the common field of interest comprises modifying a display characteristic of one or more of the remote element and the local element. ### Claim 20 (depends on 15) The method of claim 15, wherein the information comprises one or more of audio information and image information.