# US 12,192,612 B2 · Shooting method and electronic device > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,192,612 B2 - Document ID: US12192612B2 - Status: Granted - Kind: B2 - Application number: 18/041,243 - Filed: 2022-08-26 - Published: 2024-09-12 - Granted: 2025-01-07 - Earliest claimed: 2021-11-25 - Assignees: Honor Device Co., Ltd. - Applicants: Honor Device Co., Ltd. - Inventors: Shiyu Zhu; Yonghua Wang - Web page: https://patentgrep.com/patent/US12192612B2 ## CPC - H04N 23/611: where the recognised objects include parts of the human body - G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)} - G06F 3/0304: {Detection arrangements using opto-electronic means (constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042)} - H04N 23/45: for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images - H04N 23/62: Control of parameters via user interfaces - H04N 23/63: by using electronic viewfinders - H04N 23/632: {for displaying or modifying preview images prior to image capturing, e.g. variety of image resolutions or capturing parameters} - H04N 23/667: Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes - H04N 23/90: Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) ## Abstract A shooting method is provided. By implementing the shooting method provided in embodiments of this application, a terminal electronic device such as a smartphone or a smart television can determine to change a shooting mode based on a recognized user gesture. The electronic device can recognize a user's waving or sliding gesture more accurately based on the user's hand position change track in an image frame sequence and whether there are hand movements in two directions in the position changes. ## Claims ### Claim 1 A method, comprising: displaying, by an electronic device, a first interface, wherein the electronic device comprises a first camera and a second camera, wherein the first interface comprises a first preview window and a second preview window, wherein the first preview window displays an image captured in real time by the first camera, and wherein the second preview window displays an image captured in real time by the second camera; detecting, by the electronic device, a first gesture of a user; and displaying, by the electronic device, a second interface in response to the first gesture, wherein the second interface comprises a third preview window, and the third preview window displays the image captured in real time by the first camera or the image captured in real time by the second camera, wherein the detecting the first gesture of the user comprises: capturing a first image, wherein the first image is captured by the first camera or the second camera, the first image comprises a hand image, and the hand image is located at a first position in the first image; capturing a second image, wherein the second image is captured by the first camera or the second camera, the second image comprises the hand image, the hand image is located at a second position in the second image, and the second position is different from the first position; determining a first displacement vector based on the first position, wherein the first displacement vector comprises first direction information, and the first direction information identifies a first direction of the first displacement vector; determining a second displacement vector based on the second position, wherein the second displacement vector comprises second direction information, and the second direction information identifies a second direction of the second displacement vector; and determining the first gesture based on the first displacement vector and the second displacement vector. ### Claim 2 (depends on 1) The method according to claim 1, wherein the method further comprises: capturing a third image, wherein the third image is captured after the first image is captured and before the second image is captured, the third image comprises the hand image, the hand image is located at a third position in the third image, and the third position is different from both the first position and the second position, wherein the determining the first displacement vector based on the first position comprises: determining the first displacement vector based on the first position and the third position, and wherein the determining the second displacement vector based on the second position comprises: determining the second displacement vector based on the second position and the third position. ### Claim 3 (depends on 2) The method according to claim 2, wherein the determining the first gesture based on the first displacement vector and the second displacement vector comprises: when the first direction information is the same as the second direction information, determining that the first gesture is a sliding gesture. ### Claim 4 (depends on 3) The method according to claim 3, wherein the method further comprises: when the first direction information is different from the second direction information, determining that the first gesture is a waving gesture. ### Claim 5 (depends on 3) The method according to claim 3, wherein the first position is of a characteristic point of the hand image on a first coordinate axis of the first image, wherein the first coordinate axis is parallel to the ground, the second position is of the characteristic point of the hand image on the first coordinate axis of the second image, the third position is of the characteristic point of the hand image on the first coordinate axis of the third image, the first direction information is a positive direction or a negative direction of the first coordinate axis, and the second direction information is the positive direction or the negative direction of the first coordinate axis. ### Claim 6 (depends on 5) The method according to claim 5, wherein the positive direction of the first coordinate axis is a horizontal direction from left to right, and after the determining that the first gesture is the sliding gesture, the method further comprises: when the first direction information is the positive direction of the first coordinate axis, determining that the first gesture is a right-sliding gesture in the sliding gesture; or when the first direction information is the negative direction of the first coordinate axis, determining that the first gesture is a left-sliding gesture in the sliding gesture. ### Claim 7 (depends on 2) The method according to claim 2, wherein a position offset between the first position and the third position is a modulus of the first displacement vector, and a direction from the first position to the third position is the first direction information of the first displacement vector. ### Claim 8 (depends on 2) The method according to claim 2, wherein the determining the first displacement vector based on the first position and the third position comprises: determining a fourth position by using the first position and the third position, wherein a position offset between the fourth position and the third position is a modulus of the first displacement vector, and a direction from the fourth position to the third position is the first direction information of the first displacement vector. ### Claim 9 (depends on 8) The method according to claim 8, wherein the determining the fourth position by using the first position and the third position comprises: determining a fifth position corresponding to the first position, calculating a middle position between the fifth position and the third position, and determining that the middle position is the fourth position. ### Claim 10 An electronic device, comprising: a first camera; a second camera; one or more processors and one or more memories, wherein the one or more memories are coupled to the one or more processors, the one or more memories store computer program code, the computer program code comprises computer instructions, and when executing the computer instructions, the electronic device is enabled to perform operations including: displaying a first interface, wherein the first interface comprises a first preview window and a second preview window, the first preview window displays an image captured in real time by the first camera, and the second preview window displays an image captured in real time by the second camera; detecting a first gesture of a user; and displaying a second interface in response to the first gesture, wherein the second interface comprises a third preview window, and the third preview window displays the image captured in real time by the first camera or the image captured in real time by the second camera, wherein the detecting the first gesture of the user comprises: capturing a first image, wherein the first image is captured by the first camera or the second camera, the first image comprises a hand image, and the hand image is located at a first position in the first image; capturing a second image, wherein the second image is captured by the first camera or the second camera, the second image comprises the hand image, the hand image is located at a second position in the second image, and the second position is different from the first position; determining a first displacement vector based on the first position, wherein the first displacement vector comprises first direction information, and the first direction information identifies a first direction of the first displacement vector; determining a second displacement vector based on the second position, wherein the second displacement vector comprises second direction information, and the second direction information identifies a second direction of the second displacement vector; and determining the first gesture based on the first displacement vector and the second displacement vector. ### Claim 11 (depends on 10) The electronic device according to claim 10, wherein the operations further comprising: capturing a third image, wherein the third image is captured after the first image is captured and before the second image is captured, the third image comprises the hand image, the hand image is located at a third position in the third image, and the third position is different from both the first position and the second position, wherein the determining the first displacement vector based on the first position comprises: determining the first displacement vector based on the first position and the third position, and wherein the determining the second displacement vector based on the second position comprises: determining the second displacement vector based on the second position and the third position. ### Claim 12 (depends on 11) The electronic device according to claim 11, wherein the determining the first gesture based on the first displacement vector and the second displacement vector comprises: when the first direction information is the same as the second direction information, determining that the first gesture is a sliding gesture. ### Claim 13 (depends on 12) The electronic device according to claim 12, the operations further comprising: when the first direction information is different from the second direction information, determining that the first gesture is a waving gesture. ### Claim 14 (depends on 12) The electronic device according to claim 12, wherein the first position is of a characteristic point of the hand image on a first coordinate axis of the first image, wherein the first coordinate axis is parallel to the ground, the second position is of the characteristic point of the hand image on the first coordinate axis of the second image, the third position is of the characteristic point of the hand image on the first coordinate axis of the third image, the first direction information is a positive direction or a negative direction of the first coordinate axis, and the second direction information is the positive direction or the negative direction of the first coordinate axis. ### Claim 15 (depends on 14) The electronic device according to claim 14, wherein the positive direction of the first coordinate axis is a horizontal direction from left to right, and after the determining that the first gesture is the sliding gesture, the operations further comprise: when the first direction information is the positive direction of the first coordinate axis, determining that the first gesture is a right-sliding gesture in the sliding gesture; or when the first direction information is the negative direction of the first coordinate axis, determining that the first gesture is a left-sliding gesture in the sliding gesture. ### Claim 16 (depends on 11) The electronic device according to claim 11, wherein a position offset between the first position and the third position is a modulus of the first displacement vector, and a direction from the first position to the third position is the first direction information of the first displacement vector. ### Claim 17 (depends on 11) The electronic device according to claim 11, wherein the determining the first displacement vector based on the first position and the third position comprises: determining a fourth position by using the first position and the third position, wherein a position offset between the fourth position and the third position is a modulus of the first displacement vector, and a direction from the fourth position to the third position is the first direction information of the first displacement vector. ### Claim 18 (depends on 17) The electronic device according to claim 17, wherein the determining the fourth position by using the first position and the third position comprises: determining a fifth position corresponding to the first position, calculating a middle position between the fifth position and the third position, and determining that the middle position is the fourth position. ### Claim 19 (depends on 10) The electronic device according to claim 10, wherein the first camera is a front camera, and the second camera is a back camera, or the first camera is a first front camera, and the second camera is a second front camera, or the first camera is a first back camera, and the second camera is a second back camera. ### Claim 20 A non-transitory computer-readable storage medium storing instructions, wherein when an electronic device runs the instructions, the electronic device is enabled to perform operations: displaying a first interface, wherein the first interface comprises a first preview window and a second preview window, the first preview window displays an image captured in real time by a first camera, and the second preview window displays an image captured in real time by a second camera; detecting a first gesture of a user; and displaying a second interface in response to the first gesture, wherein the second interface comprises a third preview window, and the third preview window displays the image captured in real time by the first camera or the image captured in real time by the second camera, wherein the detecting the first gesture of the user comprises: capturing a first image, wherein the first image is captured by the first camera or the second camera, the first image comprises a hand image, and the hand image is located at a first position in the first image; capturing a second image, wherein the second image is captured by the first camera or the second camera, the second image comprises the hand image, the hand image is located at a second position in the second image, and the second position is different from the first position; determining a first displacement vector based on the first position, wherein the first displacement vector comprises first direction information, and the first direction information identifies a first direction of the first displacement vector; determining a second displacement vector based on the second position, wherein the second displacement vector comprises second direction information, and the second direction information identifies a second direction of the second displacement vector; and determining the first gesture based on the first displacement vector and the second displacement vector.