# US 10,120,501 B2 · Touch implementation method and device and electronic device > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,120,501 B2 - Document ID: US10120501B2 - Status: Granted - Kind: B2 - Application number: 15/086,729 - Filed: 2016-03-31 - Published: 2016-11-24 - Granted: 2018-11-06 - Earliest claimed: 2015-05-19 - Assignees: Boe Technology Group Co., Ltd. - Applicants: Boe Technology Group Co., Ltd. - Inventors: Xingxing Zhao - Web page: https://patentgrep.com/patent/US10120501B2 ## CPC - G06F 3/0418: {for error correction or compensation, e.g. based on parallax, calibration or alignment} - G06F 3/0425: {using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected (tracking a projected light spot to determine a position on a display surface G06F3/0386)} - G06F 2203/04101: 2.5D-digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface and also measures the distance of the input means within a short range in the Z direction, possibly with a separate measurement setup - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) ## Abstract A touch implementation method and device and an electronic device are provided, and the method includes: displaying N calibration points for user touch by a display screen of an electronic device; acquiring first coordinates of the N calibration points for user touch; acquiring second coordinates of the N calibration points; and calculating a mapping parameter between a first coordinate of a point and a second coordinate of the point according to the first coordinates of the N calibration points and the second coordinates of the N calibration points. The mapping parameter is configured for acquiring a first coordinate of a touch point touched by the user upon a user touching the display screen. Embodiments of present disclosure can reduce the cost of the electronic. ## Claims ### Claim 1 A touch implementation method, comprising: displaying N calibration points for user touch by a display screen of an electronic device, wherein after one calibration point is displayed on the display screen and touched by the user, a next calibration point is displayed; acquiring first coordinates of the N calibration points for user touch, wherein a first coordinate of a point refers to a pixel coordinate, at the display screen of the electronic device, of the point; the pixel coordinate is defined by a pixel distance to a default pixel at the display screen; first coordinates of at least three of the N calibration points allow the three of the N calibration points to be not in a same straight line upon the three of the N calibration points being displayed by the display screen; and N≥3 and N is an integer; acquiring second coordinates of the N calibration points, wherein a second coordinate of the point refers to a three-dimensional coordinate detected by a depth device upon the point being touched by a user; and calculating a mapping parameter between the first coordinate of the point and the second coordinate of the point according to the first coordinates of the N calibration points and the second coordinates of the N calibration points, wherein the mapping parameter is configured for acquiring a first coordinate of a touch point touched by the user upon the user touching the display screen. ### Claim 2 (depends on 1) The method according to claim 1, wherein mapping parameters K0, K1, K2, K3, K4 and K5 between the first coordinate of the point and the second coordinate of the point are calculated according to { M 0 = K 0 ⁢ X 0 + K 1 ⁢ Y 0 + K 2 ⁢ Z 0 N 0 = K 3 ⁢ X 0 + K 4 ⁢ Y 0 + K 5 ⁢ Z 0 M 1 = K 0 ⁢ X 1 + K 1 ⁢ Y 1 + K 2 ⁢ Z 1 N 1 = K 3 ⁢ X 1 + K 4 ⁢ Y 1 + K 5 ⁢ Z 1 M 2 = K 0 ⁢ X 2 + K 1 ⁢ Y 2 + K 2 ⁢ Z 2 N 2 = K 3 ⁢ X 2 + K 4 ⁢ Y 2 + K 5 ⁢ Z 2 , wherein (M0, N0) is a first coordinate of a first calibration point; (M1, N1) is a first coordinate of a second calibration point; (M2, N2) is a first coordinate of a third calibration point; (X0, Y0, Z0) is a second coordinate of the first calibration point; (X1, Y1, Z1) is a second coordinate of the second calibration point; (X2, Y2, Z2) is a second coordinate of the third calibration point; and the first calibration point, the second calibration point and the third calibration point displayed by the display screen are not in the same straight line. ### Claim 3 (depends on 2) The method according to claim 2, wherein after calculating the mapping parameter, the method further comprises: acquiring a second coordinate of the touch point touched by the user upon the user touching the display screen; and calculating the first coordinate of the touch point according to the second coordinate of the touch point and the mapping parameter. ### Claim 4 (depends on 3) The method according to claim 3, wherein the first coordinate of the touch point is calculated according to { M = K 0 ⁢ X + K 1 ⁢ Y + K 2 ⁢ Z N = K 3 ⁢ X + K 4 ⁢ Y + K 5 ⁢ Z , wherein (M, N) is the first coordinate of the touch point, and (X, Y, Z) is the second coordinate of the touch point. ### Claim 5 (depends on 1) The method according to claim 1, wherein mapping parameters K0, K1, K2, K3, K4 and K5 between the first coordinate of the point and the second coordinate of the point are calculated according to { M 0 = K 0 ⁢ X 0 + K 1 ⁢ Y 0 + K 2 ⁢ Z 0 N 0 = K 3 ⁢ X 0 + K 4 ⁢ Y 0 + K 5 ⁢ Z 0 M 1 = K 0 ⁢ X 1 + K 1 ⁢ Y 1 + K 2 ⁢ Z 1 N 1 = K 3 ⁢ X 1 + K 4 ⁢ Y 1 + K 5 ⁢ Z 1 M 2 = K 0 ⁢ X 2 + K 1 ⁢ Y 2 + K 2 ⁢ Z 2 N 2 = K 3 ⁢ X 2 + K 4 ⁢ Y 2 + K 5 ⁢ Z 2 , wherein (M0, N0) is a first coordinate of a first calibration point; (M1, N1) is a first coordinate of a second calibration point; (M2, N2) is a first coordinate of a third calibration point; (X0, Y0, Z0) is a second coordinate of the first calibration point; (X1, Y1, Z1) is a second coordinate of the second calibration point; (X2, Y2, Z2) is a second coordinate of the third calibration point; and the first calibration point, the second calibration point and the third calibration point displayed by the display screen are not in the same straight line. ### Claim 6 (depends on 5) The method according to claim 5, wherein the first coordinate of the touch point is calculated according to { M = K 0 ⁢ X + K 1 ⁢ Y + K 2 ⁢ Z N = K 3 ⁢ X + K 4 ⁢ Y + K 5 ⁢ Z , wherein (M, N) is the first coordinate of the touch point, and (X, Y, Z) is a second coordinate of the touch point. ### Claim 7 (depends on 1) The method according to claim 1, wherein after calculating the mapping parameter, the method further comprises: acquiring a second coordinate of the touch point touched by the user upon the user touching the display screen; and calculating the first coordinate of the touch point according to the second coordinate of the touch point and the mapping parameter. ### Claim 8 (depends on 1) The method according to claim 1, wherein before acquiring the first coordinates of the N calibration points for user touch, the method further comprises: detecting whether the mapping parameter needs to be calibrated, wherein acquiring the first coordinates of the N calibration points for user touch comprises: acquiring the first coordinates of the N calibration points for user touch in a situation where the mapping parameter needs to be calibrated. ### Claim 9 A touch implementation device, comprising: a display screen configured to display N calibration points for user touch, wherein after one calibration point is displayed on the display screen and touched by the user, a next calibration point is displayed; a first acquisition unit configured to acquire first coordinates of the N calibration points for user touch, wherein a first coordinate of a point refers to a pixel coordinate of the point at the display screen; the pixel coordinate is defined by a pixel distance to a default pixel at the display screen; first coordinates of at least three of the N calibration points allow the three of the N calibration points to be not in a same straight line upon the three of the N calibration points being displayed by the display screen; and N≥3 and N is an integer; a second acquisition unit configured to acquire second coordinates of the N calibration points, wherein a second coordinate of the point refers to a three-dimensional coordinate detected by a depth device upon the point being touched by a user; and a first calculating element configured to calculate a mapping parameter between the first coordinate of the point and the second coordinate of the point according to the first coordinates of the N calibration points and the second coordinates of the N calibration points, wherein the mapping parameter is configure for acquiring a first coordinate of a touch point touched by the user upon the user touching the display screen. ### Claim 10 (depends on 9) The device according to claim 9, wherein the first calculating element is configured to: calculate mapping parameters K0, K1, K2, K3, K4 and K5 between the first coordinate of the point and the second coordinate of the point according to { M 0 = K 0 ⁢ X 0 + K 1 ⁢ Y 0 + K 2 ⁢ Z 0 N 0 = K 3 ⁢ X 0 + K 4 ⁢ Y 0 + K 5 ⁢ Z 0 M 1 = K 0 ⁢ X 1 + K 1 ⁢ Y 1 + K 2 ⁢ Z 1 N 1 = K 3 ⁢ X 1 + K 4 ⁢ Y 1 + K 5 ⁢ Z 1 M 2 = K 0 ⁢ X 2 + K 1 ⁢ Y 2 + K 2 ⁢ Z 2 N 2 = K 3 ⁢ X 2 + K 4 ⁢ Y 2 + K 5 ⁢ Z 2 , wherein (M0, N0) is a first coordinate of a first calibration point; (M1, N1) is a first coordinate of a second calibration point; (M2, N2) is a first coordinate of a third calibration point; (X0, Y0, Z0) is a second coordinate of the first calibration point; (X1, Y1, Z1) is a second coordinate of the second calibration point; (X2, Y2, Z2) is a second coordinate of the third calibration point; and the first calibration point, the second calibration point and the third calibration point displayed by the display screen are not in the same straight line. ### Claim 11 (depends on 10) The device according to claim 10, wherein the second acquisition unit is also configured to acquire a second coordinate of the touch point touched by the user upon the user touching the display screen; and the device further comprises a second calculating element configured to calculate the first coordinate of the touch point according to the second coordinate of the touch point and the mapping parameter. ### Claim 12 (depends on 11) The device according to claim 11, wherein the second calculating element is configured to: calculate the first coordinate of the touch point according to { M = K 0 ⁢ X + K 1 ⁢ Y + K 2 ⁢ Z N = K 3 ⁢ X + K 4 ⁢ Y + K 5 ⁢ Z , wherein (M, N) is the first coordinate of the touch point, and (X, Y, Z) is the second coordinate of the touch point. ### Claim 13 (depends on 9) The device according to claim 9, wherein the first calculating element is configured to: calculate mapping parameters K0, K1, K2, K3, K4 and K5 between the first coordinate of the point and the second coordinate of the point according to { M 0 = K 0 ⁢ X 0 + K 1 ⁢ Y 0 + K 2 ⁢ Z 0 N 0 = K 3 ⁢ X 0 + K 4 ⁢ Y 0 + K 5 ⁢ Z 0 M 1 = K 0 ⁢ X 1 + K 1 ⁢ Y 1 + K 2 ⁢ Z 1 N 1 = K 3 ⁢ X 1 + K 4 ⁢ Y 1 + K 5 ⁢ Z 1 M 2 = K 0 ⁢ X 2 + K 1 ⁢ Y 2 + K 2 ⁢ Z 2 N 2 = K 3 ⁢ X 2 + K 4 ⁢ Y 2 + K 5 ⁢ Z 2 , wherein, (M0, N0) is a first coordinate of a first calibration point; (M1, N1) is a first coordinate of a second calibration point; (M2, N2) is a first coordinate of a third calibration point; (X0, Y0, Z0) is a second coordinate of the first calibration point; (X1, Y1, Z1) is a second coordinate of the second calibration point; (X2, Y2, Z2) is a second coordinate of the third calibration point; and the first calibration point, the second calibration point and the third calibration point displayed by the display screen are not in the same straight line. ### Claim 14 (depends on 13) The device according to claim 13, wherein the second calculating element is configured to: calculate the first coordinate of the touch point according to { M = K 0 ⁢ X + K 1 ⁢ Y + K 2 ⁢ Z N = K 3 ⁢ X + K 4 ⁢ Y + K 5 ⁢ Z , wherein (M, N) is the first coordinate of the touch point, and (X, Y, Z) is a second coordinate of the touch point. ### Claim 15 (depends on 9) The device according to claim 9, wherein the second acquisition unit is also configured to acquire a second coordinate of the touch point touched by the user upon the user touching the display screen; and the device further comprises a second calculating element configured to calculate the first coordinate of the touch point according to the second coordinate of the touch point and the mapping parameter. ### Claim 16 (depends on 9) The device according to claim 9, further comprising: a detection unit configured to detect whether the mapping parameter needs to be calibrated, wherein the first acquisition unit is configured to acquire the first coordinates of the N calibration points for user touch in a situation where the mapping parameter needs to be calibrated. ### Claim 17 (depends on 9) An electronic device, comprising the device according to claim 9. ### Claim 18 A touch implementation device, comprising: a memory and a processor, wherein the memory is configured to store a code which is configured for controlling the processor to execute a following action: displaying N calibration points for user touch by a display screen; acquiring first coordinates of the N calibration points, wherein a first coordinate of a point refers to a pixel coordinate, at the display screen, of the point; and first coordinates of at least three of the calibration points allow the three of the calibration points to be not in a same straight line upon the three of the calibration points being displayed by the display screen; acquiring second coordinates of the N calibration points, wherein a second coordinate of the point refers to a three-dimensional coordinate detected by a depth device upon the point being touched by a user; and calculating a mapping parameter between the first coordinate of the point and the second coordinate of the point according to the first coordinates of the N calibration points and the second coordinates of the N calibration points, wherein the mapping parameter is configured for acquiring a first coordinate of a touch point touched by the user upon the user touching the display screen, wherein mapping parameters K0, K1, K2, K3, K4 and K5 between the first coordinate of the point and the second coordinate of the point are calculated according to { M 0 = K 0 ⁢ X 0 + K 1 ⁢ Y 0 + K 2 ⁢ Z 0 N 0 = K 3 ⁢ X 0 + K 4 ⁢ Y 0 + K 5 ⁢ Z 0 M 1 = K 0 ⁢ X 1 + K 1 ⁢ Y 1 + K 2 ⁢ Z 1 N 1 = K 3 ⁢ X 1 + K 4 ⁢ Y 1 + K 5 ⁢ Z 1 M 2 = K 0 ⁢ X 2 + K 1 ⁢ Y 2 + K 2 ⁢ Z 2 N 2 = K 3 ⁢ X 2 + K 4 ⁢ Y 2 + K 5 ⁢ Z 2 , wherein (M0, N0) is a first coordinate of a first calibration point; (M1, N1) is a first coordinate of a second calibration point; (M2, N2) is a first coordinate of a third calibration point; (X0, Y0, Z0) is a second coordinate of the first calibration point; (X1, Y1, Z1) is a second coordinate of the second calibration point; (X2, Y2, Z2) is a second coordinate of the third calibration point; and the first calibration point, the second calibration point and the third calibration point displayed by the display screen are not in the same straight line.