# US 2017/0257660 A1 · Image Identification Based Interactive Control System and Method for Smart Television

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2017/0257660 A1
- Document ID: US20170257660A1
- Status: Published application
- Kind: A1
- Application number: 15/504,262
- Filed: 2015-07-31
- Published: 2017-09-07
- Earliest claimed: 2014-08-28
- Assignees: Shenzhen Prtek Co. Ltd.
- Applicants: Shenzhen Prtek Co. Ltd.
- Inventors: Guohua Liu
- Web page: https://patentgrep.com/patent/US20170257660A1

## CPC

- H04N 21/4223: Cameras (H04N23/00 takes precedence)
- G06F 3/002: {Specific input/output arrangements not covered by G06F3/01 - G06F3/16 (other optical apparatus G02B27/00)}
- G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)}
- G06F 3/0304: {Detection arrangements using opto-electronic means (constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042)}
- H04N 21/25891: {being end-user preferences (retrieval of video data in a video database based on user preferences G06F16/739; arrangements for recognizing users' preferences H04H60/46; user profiles in network data switching protocols H04L67/306; processing of user preferences or user profiles in wireless networks H04W8/18)}
- H04N 21/422: Input-only peripherals {, i.e. input devices connected to specially adapted client devices}, e.g. global positioning system [GPS] {(input devices also receiving signals from specially adapted client devices H04N21/4104)}
- H04N 21/44218: {Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV programme (methods or arrangements for recognising human body or animal bodies or body parts G06V40/10; methods or arrangements for acquiring or recognising human faces, facial parts, facial sketches, facial expressions G06V40/16; methods or arrangements for recognising movements or behaviour G06V40/20; arrangements for identifying users in broadcast systems H04H60/45)}
- H04N 21/4532: {involving end-user characteristics, e.g. viewer profile, preferences (monitoring of user activities for profile generation for accessing a video database G06F16/739; user profiles in network data switching protocols H04L67/306; processing of user preferences or user profiles in wireless networks H04W8/18)}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

An image recognition based interactive control system and method for a smart television. The system comprises: an image acquisition module for acquiring a card image; a gesture recognition module for recognizing a gesture of a user holding a card and outputting a gesture recognition result, wherein the gesture recognition result is channel switching, program selecting or content searching; a card recognition module for recognizing the content of the card image and outputting a card recognition result; and an interactive control module for performing a relevant interactive operation according to the gesture recognition result and the card recognition result.

## Claims

### Claim 1

An interactive control system for smart TV based on image recognition, comprising:
an image acquisition module configured to acquire a card image;
a gesture recognition module configured to recognize a gesture of a user holding the card and output a gesture recognition result, wherein the gesture recognition result is a channel switching, a program selecting or a content searching;
a card recognition module configured to recognize a content of the card image and output a card recognition result; and
an interactive control module configured to perform related interactive operation according to the gesture recognition result and the card recognition result.

### Claim 2 (depends on 1)

The system of claim 1, wherein the card image is a TV Logo, a text or a Quick Response (QR) code.

### Claim 3 (depends on 1)

The system of claim 1, wherein the image acquisition module is also configured to acquire a face image, the system further comprises:
a face recognition module configured to recognize the face image and output a corresponding prestored user information; and
a personal application management module configured to obtain favorite application information of the user according to the corresponding prestored user information and output the favorite application information to the interactive control module.

### Claim 4 (depends on 3)

The system of claim 3, wherein the face recognition module comprises:
a detecting unit configured to detect that the prestored user information corresponding to the face image exists and outputting the corresponding prestored user information, or else registering new user information by the personal application management module; and
a storing unit configured to store the new user information as the prestored user information.

### Claim 5 (depends on 3)

The system of claim 3, wherein the personal application management module comprises:
a registration unit configured to register new user information as the prestored user information; and
an automatic update unit configured to count the number of times or length of time the user watches the application and update the favorite application information of the user automatically according to the number of times or length of time the user watches the application.

### Claim 6 (depends on 1)

The system of claim 1, further comprising a gesture template configuration module configured to customize a gesture template as a preset gesture template, wherein the gesture template configuration module is further configured to output the gesture recognition result by comparing the gesture of the user with the preset gesture template.

### Claim 7

An interactive control method for smart TV based on image recognition, comprising:
acquiring a card image;
recognizing a gesture of the user holding the card and outputting a gesture recognition result, wherein the gesture recognition result is a channel switching, a program selecting or a content searching;
recognizing the content of the card image and outputting a card recognition result; and
performing related interactive operation according to the gesture recognition result and the card recognition result.

### Claim 8 (depends on 7)

The method of claim 7, wherein the card image is a TV Logo, a text or a QR code.

### Claim 9 (depends on 7)

The method of claim 7, further comprising:
acquiring a face image;
recognizing the face image and outputting a corresponding prestored user information;
obtaining a favorite application information of the user according to the corresponding prestored user information; and
switching to the corresponding application according to the favorite application information.

### Claim 10 (depends on 9)

The method of claim 9, wherein the recognizing the face image and outputting the corresponding prestored user information comprises:
detecting that the prestored user information corresponding to the face image exists and outputting the corresponding prestored user information, or else registering new user information; and
storing the new user information as the prestored user information.

### Claim 11 (depends on 9)

The method of claim 9, wherein the obtaining the favorite application information of the user according to the corresponding prestored user information comprises:
counting the number of times or length of time the user watches the application and updating the favorite application information of the user automatically according to the number of times or length of time the user watches the application; and
obtaining the updated favorite application information.

### Claim 12 (depends on 7)

The method of claim 7, further comprising:
customizing the configuration gesture template as the preset gesture template, wherein the preset gesture template is configured to be compared with the gesture of the user to output the gesture recognition result.
