# US 12,223,715 B2 · Method, system and recording medium for accessory pairing > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,223,715 B2 - Document ID: US12223715B2 - Status: Granted - Kind: B2 - Application number: 17/826,173 - Filed: 2022-05-27 - Published: 2023-05-04 - Granted: 2025-02-11 - Earliest claimed: 2021-11-03 - Assignees: HTC Corporation - Applicants: HTC Corporation - Inventors: Sheng-Yang Pan - Web page: https://patentgrep.com/patent/US12223715B2 ## CPC - G06V 20/20: in augmented reality scenes - G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80) - G06V 10/761: {Proximity, similarity or dissimilarity measures} - G06V 40/10: Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands - H04N 7/183: {for receiving images from a single remote source} - G06T 2207/30196: Human being; Person - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract A method, a system and a recording medium for accessory pairing are provided. The method comprises: determining a type of the accessory based on the identifying information of an accessory; recognizing a type of a user body part according to an image; in response to the accessory is applicable to the user body part according to the type of accessory and the type of the user body part, obtaining a first position of the accessory within an environment and obtaining a second position of the user body part within the environment; and configuring the accessory to pair the user body part according to the first position of the accessory and the second position of the user body part. ## Claims ### Claim 1 An accessory pairing method, comprising: determining a type of the accessory based on the identifying information of an accessory; recognizing a type of a user body part according to an image; in response to the accessory is applicable to the user body part according to the type of accessory and the type of the user body part, obtaining a first position of the accessory within an environment and obtaining a second position of the user body part within the environment; configuring the accessory to pair the user body part according to the first position of the accessory and the second position of the user body part; defining a candidate area of the user body part corresponding to a user in the image; defining a first reference point to indicate a first location of the user body part within the environment based on the candidate area; defining a second reference point to indicate a second location of the accessory within the environment; and wherein the configuring the accessory to pair the user body part further comprising: comparing a distance with a preset condition, wherein the distance is a distance between the first reference point and the second reference point. ### Claim 2 (depends on 1) The method according to claim 1, wherein the step of determining the type of the accessory based on the identifying information comprises: obtaining an accessory type information from the identifying information of the accessory, wherein the accessory type information indicates a function of the accessory; and determining the type of the accessory based on the accessory type information. ### Claim 3 (depends on 1) The method according to claim 1, wherein the step of recognizing the type of the user body part in the image comprises: performing an image recognition on the image to recognize the type of the user body part in the image. ### Claim 4 (depends on 1) The method according to claim 1, further comprises: converting coordinates of the reference point in the image into the location of the user body part within the environment. ### Claim 5 (depends on 1) The method according to claim 1, wherein the first position of the accessory comprises at least one of a location of the accessory and an orientation of the accessory, and the second position of the user body part comprises at least one of a location of the user body part and an orientation of the user body part. ### Claim 6 (depends on 5) The method according to claim 5, wherein after the step of obtaining the first position of the accessory within the environment and obtaining the second position of the user body part within the environment, further comprises: calculating a distance between the location of the accessory and the location of the user body part. ### Claim 7 (depends on 5) The method according to claim 5, wherein after the step of obtaining the first position of the accessory within the environment and obtaining the second position of the user body part within the environment, further comprises: calculating a relative angle between the orientation of the accessory and the orientation of the user body part between the accessory and the user body part. ### Claim 8 A display system for accessory pairing, comprising: a head-mounted display (HMD); at least one accessory; and a computing device, coupled to the HMD and the accessory, wherein the computing device is configured to determine a type of the accessory based on the identifying information of the accessory, the computing device is configured to recognize a type of a user body part according to an image, in response to the accessory is applicable to the user body part according to the type of accessory and the type of the user body part, the computing device is configured to obtain a first position of the accessory within an environment and obtaining a second position of the user body part within the environment, and the computing device is configured to: configure the accessory to pair the user body part according to the first position of the accessory and the second position of the user body part, define a candidate area of the user body part corresponding to a user in the image, define a first reference point to indicate a first location of the user body part within the environment based on the candidate area, define a second reference point to indicate a second location of the accessory within the environment, and compare a distance with a preset condition, wherein the distance is a distance between the first reference point and the second reference point. ### Claim 9 (depends on 8) The display system according to claim 8, wherein the computing device is configured to obtain an accessory type information from the identifying information of the accessory, wherein the accessory type information indicates a function of the accessory, and the computing device is configured to determine the type of the accessory based on the accessory type information. ### Claim 10 (depends on 8) The display system according to claim 8, wherein the computing device is configured to perform an image recognition on the image to recognize the type of the user body part in the image. ### Claim 11 (depends on 8) The display system according to claim 8, wherein the computing device is configured to convert coordinates of the reference point in the image into the location of the user body part within the environment. ### Claim 12 (depends on 8) The display system according to claim 8, wherein the display system further comprises an image capturing device, coupled to the computing device, wherein the image capturing is configured to capture the image and transmit the image to the computing device. ### Claim 13 (depends on 8) The display system according to claim 8, wherein the first position of the accessory comprises at least one of a location of the accessory and an orientation of the accessory, and the second position of the user body part comprises at least one of a location of the user body part and an orientation of the user body part. ### Claim 14 (depends on 13) The display system according to claim 13, wherein after obtaining the first position of the accessory within the environment and obtaining the second position of the user body part within the environment, the computing device is further configured to calculate a distance between the location of the accessory and the location of the user body part. ### Claim 15 (depends on 13) The display system according to claim 13, wherein after obtaining the first position of the accessory within the environment and obtaining the second position of the user body part within the environment, the computing device is further configured to calculate a relative angle between the orientation of the accessory and the orientation of the user body part between the accessory and the user body part. ### Claim 16 A non-transitory computer-readable recording medium, configured to record a program, wherein the program is loaded by a processor in a computing device to execute following steps: determining a type of the accessory based on the identifying information of an accessory; recognizing a type of a user body part according to an image; in response to the accessory is applicable to the user body part according to the type of accessory and the type of the user body part, obtaining a first position of the accessory within an environment and obtaining a second position of the user body part within the environment; configuring the accessory to pair the user body part according to the first position of the accessory and the second position of the user body part; defining a candidate area of the user body part corresponding to a user in the image; defining a first reference point to indicate a first location of the user body part within the environment based on the candidate area; defining a second reference point to indicate a second location of the accessory within the environment; and wherein the configuring the accessory to pair the user body part further comprising: comparing a distance with a preset condition, wherein the distance is a distance between the first reference point and the second reference point.