# US 10,946,277 B2 · Method and apparatus for controlling virtual object, and storage medium > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,946,277 B2 - Document ID: US10946277B2 - Status: Granted - Kind: B2 - Application number: 16/558,065 - Filed: 2019-08-31 - Published: 2019-12-19 - Granted: 2021-03-16 - Earliest claimed: 2017-09-12 - Assignees: Tencent Technology (Shenzhen) Company Limited - Applicants: Tencent Technology (Shenzhen) Company Limited - Inventors: Jing Liu; Li Li; Tao Wang - Web page: https://patentgrep.com/patent/US10946277B2 ## CPC - A63F 13/42: by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle - A63F 13/2145: the surface being also a display device, e.g. touch screens - A63F 13/426: involving on-screen location information, e.g. screen coordinates of an area at which the player is aiming with a light gun - A63F 13/803: Driving vehicles or craft, e.g. cars, airplanes, ships, robots or tanks - A63F 13/92: Video game devices specially adapted to be hand-held while playing - G06F 3/0488: using a touch-screen or digitiser, e.g. input of commands through traced gestures - G06F 3/04883: for inputting data by handwriting, e.g. gesture or text - G06V 40/20: Movements or behaviour, e.g. gesture recognition (recognition of facial expressions G06V40/16) - G06F 2203/04803: Split screen, i.e. subdividing the display area or the window area into separate subareas - G06F 2203/04808: Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen - A63F: CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING ## Abstract The present disclosure provides a method for controlling a virtual object. The method includes: identifying screen areas corresponding to a left virtual sub-interface and a right virtual sub-interface in a virtual interface on a screen of the terminal device; detecting a gesture operation performed in the screen area corresponding to the left virtual sub-interface and detecting a gesture operation performed in the screen area corresponding to the right virtual sub-interface; and controlling a virtual object in the virtual interface to perform an action when a gesture operation is detected in the screen area corresponding to the left virtual sub-interface and the screen area corresponding to the right virtual sub-interface. ## Claims ### Claim 1 A method for controlling a virtual object, applied to a terminal device, comprising: identifying screen areas corresponding to a left virtual sub-interface and a right virtual sub-interface in a virtual interface on a screen of the terminal device; detecting a gesture operation performed in the screen area corresponding to the left virtual sub-interface and detecting a gesture operation performed in the screen area corresponding to the right virtual sub-interface, wherein the detecting comprises: confirming a first finger landing point corresponding to a start point of a first slide gesture on the screen and a second finger landing point corresponding to a start point of a second slide gesture on the screen, in response to detecting the first slide gesture in the screen area corresponding to the left virtual sub-interface and the second slide gesture in the screen area corresponding to the right virtual sub-interface, wherein the first slide gesture and the second slide gesture are each indicative of an upward sliding or a downward sliding; and controlling the virtual object to drift in the virtual interface, according to a height difference between respective projections of the first finger landing point and the second finger landing point on a central axis of the screen; and controlling the virtual object in the virtual interface to perform an action in response to detecting the gesture operation in the screen area corresponding to the left virtual sub-interface and the gesture operation in the screen area corresponding to the right virtual sub-interface. ### Claim 2 (depends on 1) The method according to claim 1, wherein: the first slide gesture includes an upward slide gesture and the second slide gesture includes a downward slide gesture, and wherein the virtual object moves in a direction of the downward slide gesture. ### Claim 3 (depends on 1) The method according to claim 1, further comprising wherein: the virtual object is controlled to drift in the virtual interface in response to determining the height difference is greater than a first value. ### Claim 4 (depends on 1) The method according to claim 1, wherein the projection of the first finger landing point on the central axis of the screen is a first height and the projection of the second finger landing point on the central axis of the screen is a second height, the method further comprising: moving the virtual object towards the right virtual sub-interface in response to determining the first height is greater than the second height, and moving the virtual object towards the left virtual sub-interface in response to determining the second height is greater than the first height. ### Claim 5 (depends on 1) The method according to claim 1, wherein the gesture operation performed in the screen area corresponding to the right virtual sub-interface further includes a press gesture, the press gesture imparting a third finger landing point on the screen, the method further comprising: moving the virtual object in the virtual interface further in response to determining a height difference between respective projections of the first finger landing point and the third finger landing point to the central axis of the screen is greater than a third value. ### Claim 6 An apparatus for controlling a virtual object, comprising a processor and a memory, the memory storing a computer-readable instruction that is capable of causing the processor to: identify screen areas respectively corresponding to a left virtual sub-interface and a right virtual sub-interface in a virtual interface on a screen of the terminal device; detect a gesture operation performed in the screen area corresponding to the left virtual sub-interface and detect a gesture operation performed in the screen area corresponding to the right virtual sub-interface, wherein the detecting comprises: confirming a first finger landing point corresponding to a start point of a first slide gesture on the screen and a second finger landing point corresponding to a start point of a second slide gesture on the screen, in response to detecting the first slide gesture in the screen area corresponding to the left virtual sub-interface and the second slide gesture in the screen area corresponding to the right virtual sub-interface, wherein the first slide gesture and the second slide gesture are each indicative of an upward sliding or a downward sliding; and controlling the virtual object to drift in the virtual interface, according to a height difference between respective projections of the first finger landing point and the second finger landing point on a central axis of the screen; and control the virtual object in the virtual interface to perform an action in response to detecting the gesture operation in the screen area corresponding to the left virtual sub-interface and the gesture operation in the screen area corresponding to the right virtual sub-interface. ### Claim 7 (depends on 6) The apparatus according to claim 6, wherein the first slide gesture includes an upward slide gesture and the second slide gesture includes a downward slide gesture, and wherein the virtual object moves in a direction of the downward slide gesture. ### Claim 8 (depends on 6) The apparatus according to claim 6, wherein the virtual object is controlled to drift in the virtual interface in response to determining, by the processor, the height difference is greater than a first value. ### Claim 9 (depends on 6) The apparatus according to claim 6, wherein the projection of the first finger landing point on the central axis of the screen is a first height and the projection of the second finger landing point on the central axis of the screen is a second height, and wherein the computer-readable instruction further is capable of causing the processor to: move the virtual object towards the right virtual sub-interface in response to determining by the processor the first height is greater than the second height, and moving the virtual object towards the left virtual sub-interface in response to determining by the processor the second height is greater than the first height. ### Claim 10 A display device including a non-transitory computer-readable storage medium, storing a computer-readable instruction, when executed by a processor, the computer readable instruction causing the processor to perform a method for controlling a virtual object comprising: identifying screen areas corresponding to a left virtual sub-interface and a right virtual sub-interface in a virtual interface on a screen of the terminal device; detecting a gesture operation performed in the screen area corresponding to the left virtual sub-interface and detecting a gesture operation performed in the screen area corresponding to the right virtual sub-interface, wherein the detecting comprises: confirming a first finger landing point corresponding to a start point of a first slide gesture on the screen and a second finger landing point corresponding to a start point of a second slide gesture on the screen, in response to detecting the first slide gesture in the screen area corresponding to the left virtual sub-interface and the second slide gesture in the screen area corresponding to the right virtual sub-interface, wherein the first slide gesture and the second slide gesture are each indicative of an upward sliding or a downward sliding; and controlling the virtual object to drift in the virtual interface, according to a height difference between respective projections of the first finger landing point and the second finger landing point on a central axis of the screen; and controlling the virtual object in the virtual interface to perform an action in response to detecting the gesture operation in the screen area corresponding to the left virtual sub-interface and the gesture operation in the screen area corresponding to the right virtual sub-interface. ### Claim 11 (depends on 1) The method according to claim 1, wherein the gesture operation performed in the screen area corresponding to the left virtual sub-interface further includes a press gesture, the press gesture imparting a third finger landing point on the screen, the method further comprising: moving the virtual object in the virtual interface further in response to determining a height difference between respective projections of the second finger landing point and the third finger landing point to the central axis of the screen is greater than a third value. ### Claim 12 (depends on 1) The method according to claim 1, wherein the first value is a value in pixels. ### Claim 13 (depends on 1) The method according to claim 1, wherein the gesture operation performed in the screen area corresponding to the left or the right virtual sub-interface includes a click operation, the method further comprising: turning the virtual object respectively to the left or the right in response to detecting the click operation. ### Claim 14 (depends on 1) The method according to claim 1, wherein the gesture operation performed in the screen area corresponding to the left or the right virtual sub-interface includes a press gesture, the method further comprising: in response to determining the press gesture is part of the gesture operation performed in the screen area corresponding to the right virtual sub-interface, determining the first slide gesture and the press gesture are performed within a first time interval; and in response to determining the press gesture is part of the gesture operation performed in the screen area corresponding to the left virtual sub-interface, determining the second slide gesture and the press gesture are performed within a second time interval. ### Claim 15 (depends on 6) The apparatus according to claim 6, wherein the first value is a value in pixels. ### Claim 16 (depends on 6) The apparatus according to claim 6, wherein the gesture operation performed in the screen area corresponding to the left or the right virtual sub-interface includes a click operation, and wherein the computer-readable instruction further is capable of causing the processor to: turn the virtual object respectively to the left or the right in response to detecting the click operation. ### Claim 17 (depends on 6) The apparatus according to claim 6, wherein the gesture operation performed in the screen area corresponding to the left or the right virtual sub-interface includes a press gesture, and wherein the computer-readable instruction further is capable of causing the processor to: in response to determining the press gesture is part of the gesture operation performed in the screen area corresponding to the right virtual sub-interface, determine the first slide gesture and the press gesture are performed within a first time interval; and in response to determining the press gesture is part of the gesture operation performed in the screen area corresponding to the left virtual sub-interface, determine the second slide gesture and the press gesture are performed within a second time interval. ### Claim 18 (depends on 10) The display device according to claim 10, wherein the first value is a value in pixels. ### Claim 19 (depends on 10) The display device according to claim 10, wherein the gesture operation performed in the screen area corresponding to the left or the right virtual sub-interface includes a click operation, and wherein the non-transitory computer-readable storage medium further causes the processor to perform: turning the virtual object respectively to the left or the right in response to detecting the click operation. ### Claim 20 (depends on 10) The display device according to claim 10, wherein the gesture operation performed in the screen area corresponding to the left or the right virtual sub-interface includes a press gesture, and wherein the non-transitory computer-readable storage medium further causes the processor to perform: in response to determining the press gesture is part of the gesture operation performed in the screen area corresponding to the right virtual sub-interface, determining the first slide gesture and the press gesture are performed within a first time interval; and in response to determining the press gesture is part of the gesture operation performed in the screen area corresponding to the left virtual sub-interface, determining the second slide gesture and the press gesture are performed within a second time interval.