# US 10,372,225 B2 · Video display device recognizing a gesture of a user to perform a control operation and operating method thereof > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,372,225 B2 - Document ID: US10372225B2 - Status: Granted - Kind: B2 - Application number: 15/320,181 - Filed: 2014-07-29 - Published: 2017-06-01 - Granted: 2019-08-06 - Earliest claimed: 2014-06-20 - Assignees: LG Electronics Inc. - Applicants: LG Electronics Inc. - Inventors: Wooseok Ahn; Sangkyu Kang; Hyeongchul Oh; Sewon Park - Web page: https://patentgrep.com/patent/US10372225B2 ## CPC - G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)} - G06V 40/23: {Recognition of whole body movements, e.g. for sport training} - G06V 40/28: {Recognition of hand or arm movements, e.g. recognition of deaf sign language (static hand signs G06V40/113)} - H04N 21/42204: {User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor (constructive details of casings for the remote control device H01H9/0235; user interfaces for controlling a tuning device of a television receiver through a remote control H03J9/00; remote control of peripheral devices connected to a television receiver through the remote control device of the television receiver H04B1/205)} - H04N 21/42206: {characterized by hardware details} - H04N 21/4223: Cameras (H04N23/00 takes precedence) - H04N 21/44008: {involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream (arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59)} - H04N 21/44218: {Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV programme (methods or arrangements for recognising human body or animal bodies or body parts G06V40/10; methods or arrangements for acquiring or recognising human faces, facial parts, facial sketches, facial expressions G06V40/16; methods or arrangements for recognising movements or behaviour G06V40/20; arrangements for identifying users in broadcast systems H04H60/45)} - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract An operating method of a video display device, and which includes obtaining an image of a user of the video display device; generating a plurality of gesture areas for the user from the obtained image; recognizing a position of a gesture object of the user from the plurality of generated gesture areas; recognizing a gesture of the user from the obtained image; and performing a control operation corresponding to the position of the recognized gesture object and the recognized gesture. ## Claims ### Claim 1 An operating method of a video display device, the method comprising: obtaining an image of a user of the video display device; generating a plurality of gesture areas for the user from the obtained image; recognizing a position of a gesture object of the user from the plurality of generated gesture areas; recognizing a gesture of the user from the obtained image; recognizing a posture of the user from the obtained image; performing a control operation corresponding to the recognized position of the gesture object and the recognized gesture based on the recognized posture of the user, wherein the performing of the control operation comprises performing different control operations according to the recognized posture of the user even when the recognized gesture and the recognized position of the gesture object are identical, wherein the recognized posture of the user includes at least one of a user's standing posture, a user's sitting posture and a user's lying posture, and wherein the performing different control operations according to the recognized posture of the user comprises: performing a first control operation when the recognized posture of the user is a user's standing posture and the recognized gesture is a first recognized gesture and the recognized position of the gesture object is a first recognized position, and performing a second control operation when the recognized posture of the user is a user's lying posture and the recognized gesture is the first recognized gesture and the recognized position of the gesture object is the first recognized position, the second control operation being different than the first control operation. ### Claim 2 (depends on 1) The method according to claim 1, wherein the generating of the plurality of gesture areas for the user comprises: recognizing a position of a reference object of the user; and generating the plurality of gesture areas based on the recognized reference object. ### Claim 3 (depends on 2) The method according to claim 2, wherein the generating of the plurality of gesture areas based on the recognized reference object comprises generating gesture areas vertically or horizontally based on the reference object. ### Claim 4 (depends on 2) The method according to claim 2, wherein the performing of the control operation comprises performing different control operations according to the recognized position of the gesture object even when the recognized gesture is identical. ### Claim 5 (depends on 1) The method according to claim 1, wherein the gesture object comprises an object corresponding to the user's gesture. ### Claim 6 (depends on 1) The method according to claim 1, wherein the performing of the control operation comprises performing at least one control operation among channel switching, volume adjustment, screen enlargement, screen reduction, screen movement, pointer movement, screen setting, and sound setting of the video display device. ### Claim 7 (depends on 1) The method according to claim 1, further comprising recognizing a user's position from the obtained image. ### Claim 8 (depends on 7) The method according to claim 7, further comprising determining a gesture recognition rate indicating a degree of recognizing the user's gesture based on the recognized user's posture and the recognized user's position. ### Claim 9 (depends on 8) The method according to claim 8, wherein the recognizing of the user's gesture comprises recognizing the user's gesture based on the determined gesture recognition rate. ### Claim 10 A video display device comprising: an image acquisition unit obtaining an image of a user of the video display device; and a control unit generating a plurality of gesture areas for the user from the obtained image, recognizing a position of a gesture object of the user from the plurality of generated gesture areas, recognizing a gesture of the user from the obtained image, recognizing a posture of the user from the obtained image, and performing a control operation corresponding to the recognized position of the gesture object and the recognized gesture based on the recognized posture of the user, wherein the control unit is further configured to perform different control operations according to the recognized posture of the user even when the recognized gesture and the recognized position of the gesture object are identical, wherein the recognized posture of the user includes at least one of a user's standing posture, a user's sitting posture and a user's lying posture, and wherein the performing different control operations according to the recognized posture of the user comprises: performing a first control operation when the recognized posture of the user is a user's standing posture and the recognized gesture is a first recognized gesture and the recognized position of the gesture object is a first recognized position, and performing a second control operation when the recognized posture of the user is a user's lying posture and the recognized gesture is the first recognized gesture and the recognized position of the gesture object is the first recognized position, the second control operation being different than the first control operation. ### Claim 11 (depends on 10) The device according to claim 10, wherein the control unit recognizes a position of a reference object of the user and generates the plurality of gesture areas based on the recognized reference object. ### Claim 12 (depends on 11) The device according to claim 11, wherein the control unit performs different control operations according to the position of the recognized gesture object even when the recognized gesture of the user is identical. ### Claim 13 (depends on 10) The device according to claim 10, wherein the control unit recognizes a user's position from the obtained image and determines a gesture recognition rate indicating a degree of recognizing the user's gesture based on the recognized posture of the user and the recognized user's position. ### Claim 14 (depends on 13) The device according to claim 13, wherein the control unit recognizes the user's gesture based on the determined gesture recognition rate. ### Claim 15 (depends on 10) The device according to claim 10, wherein the control unit performs at least one control operation among channel switching, volume adjustment, screen enlargement, screen reduction, screen movement, pointer movement, screen setting, and sound setting based on the position of the recognized gesture object and the recognized gesture.